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SUMMARY 


This  report  reviews  factors  contributing  to  the  effects  of  lags  in  head-coupled  systems.  A 
model  of  head  tracking  behavior  is  defined  with  appropriate  feedback  loops.  The  relevant 
lags  and  their  possible  effects  on  operator  performance  are  defined.  Twenty-one  head- 
coupled  simulators  and  operational  head-coupled  airborne  systems  are  listed  and  grouped 
according  to  their  feedback  loops.  Studies  of  the  effects  of  lags  within  individual  feedback 
loops  are  reviewed.  The  feedback  loops  investigated  were  the  fiead-coupled  visual  loop, 
the  head-slaved  weapon  control  loop,  the  manual  control  loop,  the  eye-coupled  visual  loop 
and  the  eye-slaved  weapon  control  loop.  The  effects  of  relevant  task  and  simulator 
variables,  such  as  target  velocity  and  motion  cues,  are  also  discussed. 

Within  a  head-coupled  visual  loop,  many  studies  have  shown  tfiat  lags  degrade  head 
tracking  performance  (these  lags  are  referred  to  as  'display  lags').  Lag  compensation  by 
continuous  head  position  prediction  and  image  deflection  have  been  shown  to  be  very 
effective.  In  a  head-slaved  weapon  control  loop,  the  visual  feedback  of  a  lag  in  the  form  of 
a  reticle  lagging  behind  the  operators'  line-of-sight  (i.e.,  reticle  lags)  has  been  found  to 
degrade  head  tracking  performance.  Within  an  eye-slaved  weapon  control  loop,  eye 
tracking  error  increases  with  increasing  lag  (eye-retide  lag).  Systematic  investigations  of 
the  effects  of  reticle  lag,  eye-reticle  tag  and  display  iag  on  target  acquisition  performance 
are  recommended. 


The  handling  qualities  of  a  head-coupled  helicopter  simulator  have  been  reported  to  be 
degraded  by  lags  in  the  manual  control  loop,  it  is  desirable  to  consider  whether  the  results 
of  equivalent  studies  with  panel-mounted  displays  can  be  extended  to  head-coupled 
displays.  Lags  in  the  dynamic  response  of  an  eye-slaved  high  resolution  insert  (eye  display 
lags)  have  been  shown  to  degrade  lateral  manual  tracking  performance. 


Interactions  between  the  lags  in  different  feedback  loops  have  been  studied  in  a  few  cases 
but  there  are  many  variables  and  the  results  are  insufficient  to  draw  general  conclusions. 

It  is  recommended  that  future  experimental  studies  of  the  effects  of  lags  are  conducted  in 
the  context  of  an  appropriate  model  of  the  head-coupled  system. 
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1.0  INTRODUCTION 


This  report  reviews  the  effects  of  lags  on  human  performance  with  head-coupled 
simulators.  The  research  has  been  conducted  by  the  Institute  of  Sound  and  Vibration 
Research  at  the  University  of  Southampton  with  the  support  of  the  United  States  Air  Force 
through  Logicon  Technical  Services  Inc.  (F33615-89-C-0532).  The  report  summarizes  the 
work  performed  over  the  period  1  July  1992  to  30  November  1992. 

2.0  OBJECTIVES 

The  objectives  of  the  study  were: 

(i)  to  categorize  factors  that  may  contribute  to  the  lags  in  a  head-coupled  simulator; 

(ii)  to  determine  the  effect  of  each  categorized  factor  by  reference  to  previous 
experimentation  on  the  effects  of  lags  on  human  performance  or  human 
acceptance;  the  effect  of  manipulating  engineering  parameters,  such  as  bandwidth, 
phase  and  gain  was  also  to  be  reviewed; 

(iii)  to  identify  the  published  studies  concerning  interactions  among  different  lags  within 
a  simulator. 

1  above  objectives  are  slightly  different  from  the  original  objectives  in  the  prime  contract 
(  33615-89-C-0532).  The  clnges  came  about  at  the  request  of  Logicon  Technical 
Services,  Inc.  (subcontract;  07-01 4-35S). 

3.0  APPROACH  TO  CATEGORIZATION 


There  are  only  a  few  published  studies  concerned  with  the  effects  of  lags  on  operator 


performance  with  a  head-coupled  simulator.  Comprehensive  categorization  of  the 


contributions  of  individual  variables  towards  pilot  peffcrmance  is 


therefore  not  yet  possible. 


It  is  proposed  to  categorize  the  contribution  of  individual  feedback  loops,  and  their 
associated  variables,  on  the  effects  of  lags  on  pilot  performance.  A  systematic  procedure 


is  outlined  and  a  detailed  explanation  of  Stage  1  is  presented  in  Appendix  A. 
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stage  1  identity  the  systein  architecture  of  the  head-coupled  simulator  under 
investigation  so  that  a  model  can  be  constructed  (Section  5,0). 

Stage  2  identify  variables  associated  with  each  feedback  loop  and  the  effects  of 
these  variables  on  performance  within  the  model  (Section  6.0). 

Stage  3  survey  published  studies  of  interactions  among  lags  in  various  feedback 
loops  (Section  7). 

4.0  MODELING  THE  HEAD  TRACKING  SYSTEM 

4.1  Experience  from  manual  control  modeling 

Review  of  the  literature  showed  that  there  are  few  published  head  tracking  models 
compared  to  the  vast  amount  of  literature  concerning  hand  tracking  models.  Therefore,  it 
was  decided  to  develop  established  theories  of  manual  tracking  for  application  to  head 
tracking.  Section  4.1.1  outlines  the  development  of  quasi-linear  approaches  to  tracking. 
The  concept  of  modeling  the  amount  of  target  information  perceived  during  manual  tracking 
is  described  in  Section  4.1.2, 

4.1.1  Overview  of  quasMinear  approaches  to  the  modeling  of  manual  tracking 
behavior 

The  pioneer  researcher  on  the  manual  control  of  dynamic  systems  was  Arnold  Tustin.  In 
1944  he  reported  attempts  to  find  an  approximately  linear  relationship  (within  the  range  of 
practical  requirements)  between  movement  and  error  so  that  the  well-developed  theory  of 
'linear  servomechanisms'  could  be  applied.  Figure  4.1  shows  a  block  diagram  of  a  typical 
remote  position  control  servo  system  (Whiteley,  1947).  Tustin  reported  that  operators  in 
manual  control  systems  responding  to  randomly  moving  visual  forcing  functions,  exhibited 
a  type  of  behavior  analogous  to  that  of  a  servo  system  as  shown  in  Figure  4.1.  It  was 
concluded  that  manual  tracking  respor.se  is  non-linear,  but  that  the  relationship  may,  to  a 
useful  extent,  be  approximated  by  a  linear  law,  namely  that  the  speed  of  a  hand  controller 
movemnnt  proportional  to  both  the  tracking  error  and  the  rate  of  change  of  error,  subject 
to  a  lag  which  corresponds  to  that  involved  in  nerve  transmission  (Tustin  1947). 
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Power  (electric) 
input 


Equation: 

poaMon  orror  (0) 

=  knpul  •haft  poaitlan  (  6)  >  - 
output  •hadi  position  ( 0  ) 


Figure  4.1  Block  diagram  of  a  typical  remote  position  control  servo  process 
(adapted  from  Whiteley,  1947). 


Until  1960.  most  of  the  research  in  this  field  was  devoted  to  understanding  the 
characteristics  of  the  human  as  a  single-loop  linear  controller  of  a  single  variable,  the  error 
(i.e.,  the  difference  between  the  target  position  and  the  human  control  output).  This 
tracking  behavior  was  later  described  as  compensatory  tracking  by  Krendel  and  McRuer 
( 1 960).  In  this  paper,  other  types  of  tracking  mechanisms,  pursuit  and  pre-cognitive,  were 
also  reported.  Details  of  compensatory,  pursuit  and  pre-cognitive  tracking  are  discussed 
in  Section  3.1 .2.  McRuer  and  Krendel  published  a  report  in  1965  summarizing  two 
decades  of  work  concerning  compensatory  tracking  models.  The  basic  structure  of  the 
manual  control  model  developed  by  McRuer  is  shown  in  Figure  4.2.  Since  1 965,  research 
on  manual  control  dynamics  has  diversified.  At  System  Technology  Inc.  (STI),  McRuer  and 
his  colleagues  extended  their  model  to  describe  manual  pursuit  tracking  and  conducted 
numerous  studies  with  variables  such  as  secondary  tasks  and  order  of  control  dynamics 
(e.g.  Allen  et.  al,  1970). 

At  the  Bolt,  Beranek  and  Newman  Laboratory  (BBN),  Levision  et.  a!  (1969)  applied  tha 
optimal  control  theory  (Kalman,  1963)  in  modeling  compensatory  manual  tracking 
behavior.  This  led  to  the  development  of  an  optimal  human  operator  control  model 
(Figure  4.3,  Kleinman  et  a!.,  1 970),  So  far,  the  human  operator  models  mentioned  above 
were  developed  under  the  assumrhon  that  during  a  tracking  exercise,  the  human  operator 
behaves  linearly  for  most  of  the  time.  These  models  were  called  quasi-linear  operator 
models,  that  is,  models  consisting  of  a  linear  input-output  describing  function  and  a 
remnant  to  repre.s0nt  the  non-linearity  (McRuer  and  Krendel,  1965).  In  1 971 ,  Astrom  and 
Eykoff  proposed  a  general  set  of  mathematical  models  for  human  tracking  responses.  The 
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HUMkN  OPElVrOR  CTfNAMiCS 


Figure  4.2  Basic  structure  of  a  generalized  single-loop  model  for  compensatory 
control  developed  at  STI  (adapted  from  McRuer  and  Krendel,  1965). 

quasi-linear  model  was  included  in  a  sub-set  called  'Noise-Free'  model  (Figure  4.4).  Based 
on  Astrom's  general  model,  Balalcrishia  proposed  an  'Auto  Regressive  Moving  Average' 
(ARMA)  model  to  describe  compensatory  tracking  behavior.  Once  excited,  this  ARMA 
model  requires  only  previous  outputs  and  an  external  noise  input  to  simulate  the  next 
output  (Balakrishia,  1975).  That  is.  tracking  was  modeled  as  a  self  generated  behavior 
rather  than  a  response  to  a  visual  input.  Despite  the  claim  that  this  ARMA  model  produces 
better  prediction  for  manual  compensatory  tracking  response  tnan  some  quasi-linear 
models  (Balakrishia,  19/5),  the  latter  was  considered  more  suitable  in  describing  head 
tracking  behavior.  The  reasons  were  two-fold:  (i)  head  tracking  is  not  a  self  generated 
behavior  but  a  response  to  a  visual  input,  (ii)  there  is  no  single  physical  equivalent  for  the 
external  noise  source  used  in  the  ARM.^  model. 

4.1.2  Perceptual  organization:  amount  of  information  perceived 

4. 1.2.1  Review  of  literature 

in  1960,  Krendel  and  his  colleagues  explained  motor  skill  development  in  terms  of 
organization  of  perceived  target  information.  They  reported  that  as  skills  develop, 
"Successive  Organizations  of  Perception"  (SOP)  enables  an  operator  to  take  increasing 
advantage  of  the  predictability  of  perceived  target  information.  A  model  was  presented 
to  describe  how  the  predictability  of  input  signals  could  be  made  more  apparent  to  a 
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Figure  4  3  Block  diagram  of  the  optimal  human  operator  control  model  (OCM) 
developed  at  BBN  (adapted  from  Kleinman  eta/.,  1970). 


Figure  4.4  Astrom's  general  model  for  manual  tracking  behaviour  and  the  Auto 
Regressive  Moving  Average  modal  by  Balakrishia  (adapted  from  Astrom 
and  Eykoff,  1971  and  B.  akrishia,  1975). 

human  operator  by  appropriate  displays  (Figure  4.5).  They  extended  this  idea  to  predict 
the  level  of  skill  exercised  during  a  tracking  task  by  identifying  the  type  of  display  used. 
The  three  levels  of  skill  are  compensatory,  pursuit  and  pre-cognitive.  They  are  described 
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in  the  following  sections  with  their  representative  displays  in  Figure  4.5: 

(i)  Compensatory 

During  a  compensatory  tracking  task,  only  one  moving  marker  is  displayed  {Figure  4.5a). 
The  purpose  of  the  task  is  to  minimize  the  distance  between  the  marker  and  the  center 
point  reference.  The  marker  motion  is  the  difference  between  the  system  input  motion, 
i(t),  and  the  control  response,  o(t).  The  visually  displayed  movement  of  the  control 
response  is  not  distinguished  from  the  input  target  movement.  Hence,  no  anticipation  of 
the  target  is  possible. 

(ii)  Pursuit 

Unlike  compensatory  tracking,  two  moving  markers  are  displayed  during  a  pursuit  tracking 
task  (Figure  4.5b).  One  represents  the  system  input  motion,  i(t),  and  the  other  represents 
the  control  response,  o(t).  In  this  form  of  tracking  the  control  response  can  be 
distinguished  from  the  system  input  motion.  Consequently,  an  operator  can  anticipate  the 
future  target  motion  based  on  past  target  movement  and  previous  control  responses. 
Mevertheloss,  such  anticipation  will  not  be  perfect  and  the  operator  must  ope’ste  in  a 
closed-loop  fashion  relying  on  visual  feedback. 

(iii)  Precognitive 

This  condition  exists  when  the  operator  fias  complete  information  about  the  future  system 
input,  and  so  it  is  no  longer  necessary  to  maintain  continuous  closed-loop  control  of  the 
perceived  error.  Although  precognitive  control  is  not  really  tracking,  tracking  approaches 
this  condition  occasionally.  For  example,  tracking  with  periodic  target  motions:  this 
involves  the  "Synchronous  Generator"  within  the  human  operator  model  where  an  input 
stimulus  triggers  a  series  of  practiced  responses  {Figure  4.5c).  Such  open-loop  behavior 
is  achieved  through  learning  and  can  happen  with  pursuit  displays.  Another  example  will 
be  driving  on  a  familiar  road  whose  curves,  dips  and  rises  are  all  visible  far  ahead  so  that 
an  appropriate  maneuver  is  made  in  advance.  This  situation  can  bo  simulated  by  the 
"Precognitive  Display"  in  which  the  next  target  position  is  shown  in  advance.  Such  a 
display  enables  the  operator  to  function  in  an  open-loop  fashion  for  periods  of  time  that 
depend  on  a  range  of  variables  such  as  target  motion  velocity  and  control  dynamics. 
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Figure  4.5  Model  illustration  of  the  three  phases  in  Successive  Organization  of 
Perception  with  their  representative  displays  (adapted  from  Krendel  and 
McRuer,  1 960). 


4. 1.2. 2  Applications  to  head  tracking 

When  tracking  with  a  head-coupled  system,  using  visual  and  proprioceptive  i.iputs 
(Figure  4.6!,  an  operator  perceives  both  the  movements  of  the  target  position  marker  and 
the  reticio  position  marker.  The  pointing  angle  of  the  reticle  position  marker  is  tho  same 
as  that  of  the  heirnet-mounted  display.  Within  the  context  of  thi3  research,  head  tracking 
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behavior  is  modeled  as  pursuit  tracking.  However,  when  under  stress,  an  operator  may 
not  take  full  advantage  of  the  input  information  and  regress  back  to  compensatory  tracking 
(Allen  and  Jex,  1968).  Because  the  target  motions  are  assumed  to  be  random,  progress 
to  the  precogt  litive  stage  is  considered  impossible. 
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d I  CP  lay  Is  h»l mot-mountad 
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ECTD 


Human 
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Remnant 


R: 

T; 


ret  Idle  marker 
target  marker 


helmet  po I  n- 
Ing  cyctem 


ICr^  Is  the  original  target  notion. 


cubjectivo  rating 


Output 

ocn 


la  tho  radial  espsratlon  betwaan  the  target  and  tha  rat  Ida. 

RCf^  IS  the  reticle  position  which  is  the  same  as  the  pointing 
angle  of  tha  helmat-nounlad  diapiny  . 


RCO*'ECr3  la  tha  parcalvod  torgat  motion. 


Figure  4.6  A  quasi-linear  pursuit  model  of  a  typical  head  tracking  loop  within  a 
head-coupled  system. 


4.2  Head-coupled  simulator  modeling  foperator-in-the-loop) 

A  model  of  a  basic  oporator-in-the-loop  head-coupled  simulator  is  shown  in  Figure  4.7. 
This  model  contains  only  one  feedback  loop  and  the  whole  system  is  described  as  the 
'head-coupled  visual  loop'.  Examples  of  variables  involved  in  this  loop  are  listed  in 
Appendix  A.  Simulator  components  are  added  to  the  'head-coupled  visual  loop'  system 
to  form  a  more  complex  head-ci  jpled  simulation  system;  this  results  in  more  feedback 
loops  (see  Figure  4.8). 

i.O  MODELS  OF  VARIOUS  KEAD-COUPLED  SIMULATORS 

A  review  of  published  literature  concerning  various  head-coupled  systems  has  been 
Gondur  ted.  The  systems  reviewed  are  *'Sted  in  Tables  5.1  and  5.2  and  included  both 
opeiational  systems  and  research  simulators. 
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Figure  4.7  Diagrammatic  illustration  of  a  mode!  of  a  simple  pilot-in-the-loop  head-coupled  simulator. 


ALM:  By9-8lavBd  weapon  contra!  loop; 

ALEF:  aya-slaved  hi-rasolution  insad. 

Figure  4.8  Diagrammatic  illustration  of  a  model  of  a  typical  pilot-in-the-loop  head-coupled  simulator. 


Table  5.1  Structure  of  head-coupled  simulators  described  in  known  published  literature. 


ICey;  0  =  component  not  prasen”,  1  «  componont  preient,  *  =  ic  Im  d^v^lop^d.  hl*nk  —  not  fnonltonfld  in  thd  document(i)  foviawod, 

nn  -  morK>cuiar  HMD,  b  =:  binocular  HMD. 


../  continued  from  Table  5.1 


Key:  0  e  compooent  not  preeert.  1  s  ccn^ponent  preient,  *  x  to  bo  doveiopod,  b'enk  =  not  mor^tk>n«d  in  tho  documerttis)  reviewed. 

fT.  V  monccufer  HMD.  b  =  binocLrier  HMD. 


Head>coLipM  timufitor  component! 


Key:  0  =  component  not  pre.onl.  1  =  component  proeeni.  '=  to  be  developed,  blank  =  not  mentioned  in  the  documer.tlij  reviewed, 

m  =  monocular  HMD.  b  =  birwcular  HMD.  b'  =  biocular  HMD.  a  =  lymbology  only. 


6.0  EFFECTS  OF  VARIABLES  ASSOCIATED  WITH  INDIVIDUAL  FEEDBACK  LOOPS 


This  section  reviews  published  studies  concerned  with  the  effects  of  lags  within  individual 
feedback  loops  in  head-coupled  systems.  One  problem  with  selecting  papers  for  this 
review  is  that  the  papers'  authors  were  not  always  primarily  concerned  with  the  effect  of 
lags  and  sc  all  of  the  desired  information  is  not  always  available. 

The  studies  are  presented  in  a  style  similar  to  that  of  the  Engineering  Data  Compendium 
(Boff  and  Lincoln,  1988).  Studies  concerned  with  the  effect  of  lags  within  the  same 
feedback  loop  are  grouped  (subsections  6.1  to  6.5). 

6.1  Head-coupled  visual  loop 

A  block  diagram  showing  a  head-coupled  visual  loop  within  a  simulator  is  shown  In 
Figure  4.8. 

The  variables  investigated  in  this  section  are  listed  as  follows; 

(i)  lag-induced  image  position  error  (Section  6.1.1); 

(ii)  display  lag  (Section  6,1.2): 

(iii)  exponential  display  lag  (Section  6.1.3); 

(iv)  time  le.‘2d  and  display  lag  (Section  6.1.4). 

(v)  lag  compensation  by  image  deflection  and  head  position  prediction  (Section 
6.1.5). 


6.1 .1  Lag-induced  image  position  error 


General  description 

Head-coupled  systems  comprise  helmet-mounted  displays,  helmet-pointing  systems  and 
host  computers  for  graphics  generation.  Such  systems  enable  an  operator  to  view 
continuously  information  appropriate  to  the  instantaneous  line-of-sight  of  the  head. 
Problems  arise  with  the  inevitable  lags  betv/eon  the  moment  at  which  head  orientation  is 
sampled  and  the  moment  at  which  the  image  is  presented  on  the  display.  This  type  of  lag 
has  previously  been  referred  to  as  target  presentation  lag  (ref.  5),  transmission  lag  (ref.  2) 
and  display  lag  (ref.  3).  The  lag  represents  the  dynamic  response  of  the  entire  visual  field 
of  a  head-coupled  system  to  head  movement  and  will  be  hereafter  referred  to  as  'display 
lag'.  Within  the  context  of  this  report,  an  aiming  reticle  is  not  included  as  part  of  the 
visual  field  and  is  not  subjected  to  the  display  lag. 

With  a  display  lag  and  continuous  head  movement,  head-coupied  images  are  displayed  at 
incorrect  positions.  The  generation  of  such  image  position  error  is  illustrated  in 
Figure  6.1.  This  image  position  error  has  been  referred  to  as  display  orientation  error 
(ref.  1 ).  The  display  lag  increases  linearly  with  increasing  frame  period  or  graphic  update 
time  (Figure  6.2,  ref.  2).  The  image  position  error  also  increases  linearly  with  the  head 
movement  velocity  (Figure  6.3)  and  the  magnitude  of  the  display  lag. 

Applications 

Understanding  of  any  degradation  in  visual  control  performance  with  head-coupled 
systems. 

methods 

Two  studies,  reported  by  different  authors,  are  reviewed  here.  The  study  in  ref.  2 
investigated  the  position  error  introduced  by  the  display  lag  from  an  engineering  point-of- 
view  and  no  human  response  was  considered.  The  study  in  ref.  6,  however,  included 
human  response  to  the  display  lag  in  the  measurements  of  lag- induced  position  error. 
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images  seen  on  the  display 

f  _ _ 


rp' (6h-o.) 

L 

•posicton 

«rror 

no  lag  with  lag 

Figure  6.1  Diagrammatic  illustration  of  the  effect  of  lag  between  head  movement 
and  image  movement  on  an  image  captured  by  a  head-slaved  camera  {The  effect  is 
similar  to  that  of  display  lags,  adapted  from  ref.  6). 


Test  conditions  (ref.  2) 

•  Display  (transmission)  lags  were  measured  with  different  graphic  update  times  (10  ms 
to  300  ms).  Measurements  were  repeated  when  a  data  buffer  was  inserted  into  the  head- 

i  coupled  sy.stem  to  generate  extra  lags  (a  data  buffer  may  be  treated  as  a  frame  store  in 

terms  of  its  time  delay  characteristic). 

^  •  Image  position  errors  for  head-coupied  images  were  measured  with  different  graphic 

update  times  (10  ms  to  300  ms;  and  different  head  (tracker)  translational  veloc.ties 

(0.0221  m/s  to  0-0558  m/s). 

I 

J 

I  Exparimantal  details  (ref.  2) 

I 

i 

•  Independent  variables:  graphic  update  time;  head  (tracker)  velocity;  the  presence  of  a 
data  buffer. 


•  Dependent  variables:  display  lag;  image  position  error. 

1 


1 
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•  Experimenter's  task:  move  the  head 
tracker  at  a  pre-arranged  velocity. 


•  No  subject  was  used. 

Test  conditions  (ref.  6S 

•  Image  position  errors  for  head-coupled 
images  were  measured  with  different 
display  lags  (40  ms  to  420  ms).  These 
errors  were  compensated  by  image 
deflection  and  measured  in  terms  of  the 
amount  of  deflection  needed  Figure  6.4, 
(see  Section  6.1 .5  for  details  on  the  image 
deflection  technique). 


Figure  6.2  Display  lags  for  different 
graphic  update  times  with  and  without  a  data 
buffer  (line  fittings  are  given,  adapted  from 
ref.  2). 


e  The  target  motions  used  in  both  pitch 
and  yaw  axes  were  random  signals 
integrated  twice  and  band-pass  filtered 
between  0.01  and  0.63  Hz. 

Experiment  details  (ref.  6} 

*  Independent  variable:  display  lag. 

•  Dependent  variables;  image  position 
error  in  terms  of  the  amount  of  deflection 
needed. 


Figure  6,3  Position  errors  versus  heed 

(♦raoW'orV  'for  orar\Hir*e*  i  irtrisaftt  tirr^oQ  r\4 

«,«  W  I  pi  >1 WW  v«7  vititww  w< 

30,  50  and  100  ms  (adapted  from  ref.  2). 


•  Subject's  task:  track  a  moving  target 
with  the  head. 


‘I  Twelve  male  subjects  participated. 


Results 

«  The  visual  effect  of  display  lag  on  a 
head-coupled  image  is  illustrated  in 
Figure  6.1 .  Although  computer-generated 
images  were  used  in  all  the  studies 
reviewed,  a  head-slaved  camera  is  used  for 
illustration.  Figure  6.1  shows  the  affect 
on  the  displayed  image  when  the  head  of 
an  operator  moves  to  acquire  a  stationary 
target  at  a  constant  angular  velocity,  fj*. 
assuming  the  head-slaved  camera  follows 
with  a  constant  time  delay,  r.  After  a 
time,  t.  the  head  has  traveled  an  angle  of: 

Q.  =  Snt 

but  the  camera  and  images  captured  have 
only  moved  to  6^.  where: 

Qc  =  -  T) 

=  e.  -  Lt 


Figure  6.4  Yaw-axis  r.m.s.  image 
displacement  by  deflection  (i.e.  position 
error)  for  different  display  lags  (adapted  from 
ref.  6). 


Therefore,  the  image  position  error,  dj,  is  proportional  to  the  head  velocity, 


•  The  relationship  between  display  lag  and  graphic  update  time  is  modeled  as  follows 
(Figure  6.2): 

display  lag  =  a  -l-  b  x  (graphic  update  time) 

where 

a  =  lag  of  the  helmet-pointing  system  (tracker)  +  the  processing  time  of  the 
host  computer  to  generate  a  complete  graphic  frame, 
b  =  a  constant  proportional  to  the  number  of  data  buffers  within  the  head- 
coupled  visual  loop  of  a  head-coupled  system. 


*  Image  position  errors  in  head-coupled  displays  increase  linearly  with  head  (tracker) 
velocity  (Figure  6.3).  This  agrees  with  Figure  6.1. 

•  Image  position  errors  in  head-coupled  displays  increase  linearly  with  display  lag 
(Figure  6.4). 
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Comparison  with  othar  studies 


•  The  reported  linear  relationship  between  the  position  error  and  the  head  velocity  was 
confirmed  by  the  result  of  a  study  reported  in  ref.  5.  With  display  lags  from  0  ms  to 
160  ms,  changing  the  velocity  of  a  target  motion  by  scaling  its  displacement  produced  no 
significant  effect  on  head  tracking  performance  other  than  the  linear  changes  due  to 
displacement  scaling  (the  system  display  lag  was  40  ms). 

References  (*:  key  refeii'ence(s)) 

1 .  Allen  and  Hebb  (1983)  ‘2.  Bryson  and  Fisher  (1990) 

3.  Eyre  and  Griffin  (1992)  4.  Lewis  et.  a/ (1987) 

5.  So  and  Griffin  (1991a)  *6.  So  and  Griffin  (1991b) 


6.1 .2  Display 


I 

I 


I 


I 


General  descript’ort 

Image  movements  on  ail  head-coupled  systems  are  subject  to  display  lags  (see 
Section  6.1.1  for  definiLicn,  Figure  6.5).  For  a  band-limited  random  target  motion,  head 
hacking  performance  can  bo  significantly  degraded  by  imposed  display  lags  greater  than, 
or  equal  tc .  40  ms  (Figute  6.6,  the  system  display  iag  was  40  ms).  Ref.  3  reported  that 
in  the  presence  of  display  lags,  no  significant  improvement  in  head  tracking  performance 
was  found  through  practice  (Figure  6.7).  Display  lags  were  shown  to  increase  the  gains 
and  the  pha.so  lags  in  head  tracking  transfer  functions  with  a  band-limited  random  target 
motion  (Figt  'e  6  8).  Thase  increases  resulted  in  increased  input-correlated  tracking  errors 
(Figure  6.9). 

Applications 

Design  of  control  systems  with  head-coupled  visual  feedback. 

Methods 

Two  studies  ere  reviewed  here,  they  were  reported  by  the  same  authors  and  the  head- 
coupiad  systems  used  in  both  experiments  were  the  same  (Figure  6.5).  The  helmet- 
mounted  display  used  was  a  monocular  system  and  the  eye  of  presentation  was  the  right 
eye. 


Test  cor^ditions  (ret.  4) 

•  Mean  radial  head  tracking  error  and  subjective  difficulty  rating  were  measured  with 
different  imposed  display  lags  (0  ms  to  380  ms,  Figure  6.6).  The  system  di-play  lag  was 
40  ms. 

•  The  target  motions  used  in  both  pitch  and  yaw  axes  were  random  signals  integrated 
twice  and  band-pass  filtered  between  0.01  and  0.63  Hz.  The  duration  was  60  seconds. 
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Figure  6.5  A  diagrammatic  illustration  of  a  head-coupled  system  with  a  display  lag. 


Experimental  details  (ref.  4) 

•  Independent  variable:  display  lag. 

•  Dependent  variables:  mean  radial  head 
tracking  error  and  subjective  difficulty  rating. 

•  Subject's  task:  track  a  moving  target  with 
a  reticle.  Both  the  target  and  the  reticle 
were  presented  on  a  monocular  helmet- 
mounted  display  at  optical  infinity.  The 
reticle  was  presented  at  the  center  of  the 
display. 

•  Twelve  male  subjects  participated.  They 


I _ 1 _ I - ^ - 1 
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Figure  6.6a  Mean  radial  tracking  error 
with  different  display  lags  (Median  of  1  2 
subjects,  adapted  from  ref.  4). 


were  either  students  or  researchers. 


Test  cuiiditiciis  (ref.  3} 


•  With  0  ms  and  80  ms  imposed  display  iags,  mean  radial  head  tracking  error  was 
measured  for  ten  consecutive  trials  to  study  learning  effects  (Figure  6.7).  The  system 
display  lag  was  40  ms. 


•  Head  tracking  tran.sfer  functions  and  both  input-correlated  and  uncorrelated  tracking 
error  spectra  were  measured  with  different  imposed  display  lags  (0  ms  to  1 60  ms, 
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Figures  6.8  arid  6.9). 


•  The  target  motions  used  i  i  both  pitch  and 
yaw  axes  were  random  signals  integrated 
once  and  then  low-pass  filtered  at  0.7  Hz 
(24  dB/octave)  and  ^  Hz  (1 20  dB/octave). 
The  duration  was  1 20  seconds. 

Experimental  details  (ref.  3) 

•  Independent  variables  and  subject's  task 
are  the  same  as  in  ref.  4. 
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Figure  6.6b  Subjective  difficulty  rating 

with  different  display  lags.  (Median  of  1 2 

„  ...  L  .  subjects,  adapted  from  ref.  4). 

•  Dependent  variaoles:  head  displacement 

(pitch  and  yaw  axes)  expressed  as  mean  radial  error,  head  tracking  transfer  function  and 
input-correlated  and  uncorrelated  error  spectra. 


•  Eight  male  subjects  participated.  They 
wore  either  students  or  researchers. 

Results 

•  Head  tracking  performance  was  found  to 
be  degraded  for  imposed  display  lags 
greater  than,  or  equal  to,  40  ms 
(Figure  6.6,  the  system  display  lag  was 
40  ms).  About  65%  of  the  increase  in 
votal  tracking  error  was  input-correlated 
(Figure  6.9). 
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Figure  6.7  Mean  radial  error  for  1 0 
learning  stages  with  80  and  1 20  ms  display 
lags  (median  and  inter-quartiie  range  for  8 
subjects,  adapted  from  ref.  3). 


•  No  significant  improvement  in  head  tracking  performance  in  the  presence  of  0  ms  and 
40  ms  imposed  display  lags  was  found  through  oractice  (Figure  6.6). 


•  Both  the  gains  and  the  phase  lags  in  head  tracking  transfer  functions  increased  with 
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increasing  display  lag  (Figure  6.8).  This  indicated  that  the  operator  tracking  strategy  may 
have  been  affected  by  the  display  lags. 


Figure  6.8  Mean  head  tracking  transfer  functions  in  the  yaw-axis  with  different 
display  lags  (Hanning  window,  144  degrees  of  freedom,  0.09  Hz  resolution,  adapted 
from  ref.  3). 


Figure  6.9  Mean  input-correlated  and  uncorrelated  yaw-axis  head  tracking  error 
spectra  with  different  display  lags  (Haririing  vVindow,  144  degrees  cf  freedorn,  C.OD  Hz 
resolution,  adapted  from  ref.  3). 


Comparison  with  other  studies 
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•  Figure  6.10  indicates  a  similar  finding 
from  ref.  1  for  the  effect  of  display  lag  on 
head  tracking  performance.  The 
experimental  head-coupled  system  used  in 
ref.  1  was  different  from  that  used  in 
ref.  4  (see  Table  5.1 ,  Section  5.0). 

•  Ref.  2  reported  that  display  lags  tan 
cause  motion  sickness. 

Figure  6.10  Mean  radial  head  tracking  error 

•  Ref.  6  reported  that  in  a  helicopter  with  different  display  lags  (adapted  from 

combat  mission  simulation,  the  computer 

scene  could  not  keep  up  with  the  high  turn  rates  inherent  in  an  aggressive  maneuver,  the 
simulator  had  a  display  lag  of  1 20  ms. 

•  A  monocular  helmet-mounted  display  (HMD)  was  used  in  both  studies  (refs.  3  and  4). 
The  eye  of  presentation  of  the  HMD  was  always  the  right  eye.  Ref.  5  investigated  the 
affect  of  the  eye  of  presentation  during  head  aiming  and  tracking,  no  significant  effect  on 
performance  was  reported. 

Constraints 

•  The  studies  were  focused  on  the  effects  of  display  lag  on  continuous  tracking.  Other 
tasks  such  as  target  acquisition  involving  ballistic  head  movement  may  need  further 
attention. 

References  (*;  key  refercncefs)) 

1.  Eyre  and  Griffin  (1992) 

2.  Friedman  et.  a!  (1992) 

•3.  So  and  Griffin  (1991a) 

*4.  So  and  Griffin  (1991b) 

5.  Wells  and  Griffin  (1987b) 

6.  Williams  (1987) 
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6.1.3  Exponential  display  lags 


General  description 

When  a  head-coupled  system  is  used  to  present  images  captured  by  a  head-slaved  camera, 
the  delay  (i.e.  display  lag,  see  Section  6.1.1  for  definition)  is  replaced  by  an  exponential 
lag.  This  exponential  lag  represents  the  dynamic  response  of  the  head-slaved  camera  and 
is  hereafter  referred  to  as  exponential  display  lag  (Figure  6.1 1 ).  When  such  head-coupled 
systems  are  used  to  search  and  identify  visual  objects,  the  effect  of  increasing  the  delay 
time  constant  (r)  of  an  exponential  lag  is  likely  to  increase  the  searching  time  (Figure.s  6.12 
and  6.13)  and  constrains  an  operator  from  making  fast  head  motions  (Figure  6.14). 


;'regu«ncy  (Ui) 


Frequuicy  (Hz) 


Figure  6.1 1  Frequency  responses  of  exponential  display  lag  of  different  time  constants 

(adapted  from  rnf.  2). 


Applications 

Design  of  tolo-operated  .systems  and  hoad-coupled  forward  looking  infrared  radiation  (FLIR) 
systems. 

Methods 

Test  conditions  (ref.  2) 

•  One-dimensional  character  search  with  a  head-coupled  system;  the  characters  were  the 
twenty-six  letters  of  the  alphabet  presented  in  a  random  order.  Character  position  was 
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generated  randomly  between  -70°  to  -10° 
and  from  +10°  to  +70°  from  boresight 
along  the  horizontal  median. 

tt  Percentage  reading  error  and  total  time 
taken  to  complete  the  task  ware  measured 
with  different  exponential  dis  play  lags  (e'*^': 
r  from  0.003  to  0.318  seconds 
corresponding  to  a  1"  order  low-pass  filter 


U  OOl  u.ul  o. 

TlB*  kOnitAitl  lAI 


with  cut-off  frequencies  from  50  to 
0.5  Hz). 

Test  conditions  (ref.  1) 


Figure  6.12  Time  taken  to  search  and 
recognize  26  letters  with  different 
exponential  display  lags  (adapted  from 
ref.  2). 


•  Estimation  of  the  flight  path  in  a  simulated  straight  or  curved  level  flight  with  a  head- 
coupled  system  (see  Experimental  Details  section  for  a  summary  of  the  estimation 
procedure). 


•  Estimation  error,  time  and  yaw-axis 
movement  and  velocity  were  measured 
with  and  without  a  1“  order  exponential 
display  lag  (e  *^®*).  The  error  and  head 
velocity  measurements  were  repte.sented 
by  their  standard  deviations,  since  their 
means  were  approximately  zero.  Their 
standard  deviations  were  approximately 
equal  to  the  r.m.s.  values. 

Experimental  details  (ref.  2) 


(level  tli){hcs) 

Figure  6.13  Flight  path  estimation  time 
with  and  without  an  exponential  display  lag 
of  (adapted  from  ref.  1). 


•  Independent  variable;  exponential  display  lag. 


®  Dependent  variables;  percentage  reading  error  and  reading  time. 
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•  Subject's  task:  start  from  a  forward 
facing  position,  turn  the  head  to  the  ieft 
until  a  character  is  located,  call  out  the 
character  and  turn  the  head  to  the  right 
until  another  character  is  located.  This  is 
repeated  until  all  of  the  twenty-six 
characters  hiive  been  read. 

•  Seven  male  subjects  participated. 

Experimental  details  (ref.  1 ) 

•  Independent  variable:  exponential  display 
lag. 


(level  lliglits) 

Figure  6.14  Yaw-axis  head  motion 
velocities  (standard  deviation)  in  the  flight 
path  estimation  task  with  and  without  an 
exponential  display  lag  of  e  "°®*  (adapted 
from  ref.  1 ). 


•  Dependent  variables:  flight  path  estimation  error  and  time;  standard  deviations  of  yaw- 
axis  head  movement  and  velocity. 


•  Subject's  task:  on  pressing  a  response  button,  a  simulated  helicopter  flight  was 
presented.  Within  the  visual  field,  a  marker  was  placed  on  the  ground  level,  at  zero  yaw 
angle  and  at  a  specified  depth.  Subjects  wero  asked  to  place  the  marker  along  the 
anticipated  flight  path  at  the  specified  depth  and  press  the  response  button  when  finished. 

e  Eight  male  and  one  female  trained  subjects  participated. 


Results  (ref.  2) 

•  Figure  8.12  she  vs  that  for  a  time  constant  greater  than,  or  equal  to,  0.04  seconds, 
there  was  i  consistent  degradation  in  reading  time  with  increasing  exponential  display  lag. 

•  Reading  er'ors  were  not  consistently  affected  by  the  exponential  display  lag  (data  not 
shown  here,  see  ref.  2).  In  a  character  search  task,  when  a  subject  is  under  stress,  a 
trade-off  wou'd  normally  be  expected  between  reading  time  and  reading  error. 
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Results  (ref.  1 ) 

•  When  an  exponential  display  lag  with  a 

time  constant  of  0.5  seconds  was 

introduced,  the  average  estimation  time  of 
the  flight  paths  in  simulated  helicopter 
flights  increased  by  30%  (Figure  6.13). 

•  The  effect  of  the  exponential  lag  on  the 
flight  path  estimation  error  was  slight  (4% 
increases,  data  not  shown  here). 

•  With  the  exponential  display  lag  (e  "°®‘). 


Figure  6.1  5  Yaw-axis  head  displacements 
(standard  deviation)  in  the  flight  path 
estimation  task  with  and  without  an 
exponential  display  lag  of  e  "°®*  (adapted 
from  ref.  1). 


yaw-axis  head  velocity  decreased  by 

approximately  53%  (Figure  6.14).  In  contrast,  the  yaw-axis  head  displacement  increased 
by  14%  (Figure  6.1 5).  This  may  suggest  that  the  exponential  display  lag  constrained  the 
subjects  from  making  fast  head  n>otions,  requiring  them  to  make  more  corrections,  and 


resulted  in  larger  estimation  times. 


Constraints 


•  The  findings  from  the  tv'o  studies  (refs.  1  and  2)  cannot  be  compared  directly,  because 
flight  path  estimation  is  mure  complicated  than  a  character  search  task.  The  performance 
of  the  former  task  is  more  dependent  on  subject  experience. 


•  Only  one  dimensional  character  search  was  studied. 


References  (*;  key  reference! s)) 


*  1 .  Grunwald  et.  a/  ( 1 99 1 ) 


*2.  Lewis  et.  a!  (1987) 
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6.1 .4  Combined  effect  of  time  lead  and  display  lag 


General  description 

In  previous  sections  (6.1.1  to  6. 1 .4),  the  degradation  effects  of  display  lag  on  performance 
have  been  discussed.  A  solution  to  this  lag-induced  problem  is  to  predict  the  future  head 
position  by  a  signal  processing  algorithm.  For  random  movements  of  the  head,  prediction 
is,  by  definition,  impossible.  However,  due  to  the  limited  tracking  bandwidth  of  the  human 
head  (up  to  1  Hz,  Wells  and  Griffin,  1 987b),  prediction  of  head  position  becomes  possible. 
A  model  of  a  head-coupled  visual  loop  with  a  head  position  predictor  is  shown  in 
Figure  6.1 6.  With  imposed  lags  greater  than,  or  equal  to,  80  ms  the  use  of  an  optimized 
phase  lead  filter  with  48  ms  lead  reduced  the  mean  radial  head  tracking  error  (Figures  6.17 
and  6.18).  Intha  case  of  the  optimi7;  i  phase  lead  filter  with  1 1 7  ms  lead,  the  mean  radial 
head  tracking  error  was  reduced  when  the  imposed  lag  was  equal  to  1 00  ms  (the  system 
display  lag  was  40  ms).  It  was  reported  that  the  gain  amplification  of  the  filter,  above  the 
target  motion  frequency  range  of  0  to  0.7  Hz,  magnified  the  measurement  noise  which, 
in  turn,  caused  the  visual  images  to  jitter.  The  jittering  of  the  images  were  found  to  force 
the  human  operator  to  adopt  a  different  strategy  that  produced  moro  tracking  error 
(Figure  6.19). 


Figure  6.1 6  Block  diagram  of  a  head-coupled  visual  loop  with  a  display  lag  and  a  head 
position  predictor  (adapted  from  ref.  6). 


Appiicatioiis 

Design  of  helmet-pointing  system  and  head-coupled  simulator. 
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Figure  6.17  Frequency  responses  of  the  two  phase  lead  filters  used  in  ref.  5. 
Methods  (ref.  6) 


Test  conditions 


•  Mean  radial  head  tracking  error  was  measured  with  different  imposed  display  lags  (0  ms 
to  100  ms)  and  three  filtering  conditions  (no  filter,  filters  A  and  B,  Figure  6.17). 

•  The  two  phase  lead  filters  (A  and  B)  were  optimized  so  as  to  produce  time  lead  at  the 
frequency  range  0  to  0.6  Hz.  Their  equations  are  (sampling  rate  -  50  Hz): 
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Figure  6.18  Mean  radial  error  with  different 
display  lags  and  phase  lead  filters  (adapted 
from  ref.  6). 


The  frequency  response.s  of  Filter  A  and  Filter  B  are  shown  in  Figure  6.17. 
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Figure  6.19  Mean  head  tracking  transfer  functions  measured  between  A  and  B1  and 
between  A  and  B2  (Figure  6.1)  with  80  ms  and  100  ms  imposed  lags  and  different 
filtering  conditions  (0.078  Hz,  124  degrees  of  freedom,  adapted  from  ref.  6). 


•  The  target  motions  used  in  both  pitch  and  yaw  axes  were  random  signals  integrated 
twice  and  band-pass  filtered  between  0.01  and  0.64  Hz  (48  dB/octave).  The  duration  of 
each  task  was  90  seconds. 

Experimental  detoils 

•  Independent  variables;  display  lag  and  phase  lead  filtering. 

•  Dependant  variables;  mean  radial  tracking  error  and  head  tracking  transfer  functions. 

•  Subject's  task:  track  a  moving  target  with  a  reticle.  Both  the  target  and  the  reticle  were 
presented  on  a  monocular  helmet-mounted  display  at  optical  infinity.  The  reticle  was 
presented  at  the  center  of  the  display. 

•  Six  male  subjects  participated.  They  were  either  students  or  researchers. 
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Results 


•  With  the  use  of  filter  A,  which  had  a  48  ms  lead,  mean  radial  error  was  significantly 
reduced  when  the  imposed  lag  was  greater  than,  or  equal  to,  100  ms  (p<0.05,  Wilcoxon 
matched-pairs  signed  ranks  tests). 

•  For  imposed  time  delays  less  than,  or  equal  to,  20  ms  however,  mean  radial  error  was 
significantly  increased  with  the  use  of  filter  B,  which  had  117  ms  lead  (p<0,05, 
Wilcoxon).  This  was  because  the  time  lead  produced  by  the  filter  was  greater  than  the 
total  display  lag  present  (total  lag  =  imposed  lag  +  system  lag). 

•  From  Figure  6.1 9,  it  can  be  observed  that  the  use  of  filter  B  forced  the  subjects  to  adopt 
new  tracking  strategies  which  produced  more  phase  lags.  Consequently,  with  the  1 00  ms 
time  delay  condition,  the  use  of  filte'  B  produced  less  improvement  in  the  tracking  error 
than  filter  A.  even  though  filter  B  had  a  longer  prediction  time  (Figure  6.17).  The  changes 
in  tracking  strategy  when  filter  B  was  used  were  thought  to  have  been  due  to  the  jittering 
of  images  produced  by  amplified  measurement  noise.  Lag  compensation  by  filter  B 
induced  a  higher  subjective  difficulty  rating  for  the  tracking  tasks  than  lag  compensation 
by  filter  A  (data  not  shown  here). 

Comparison  with  other  studios 

•  Ref.  3  reported  a  computer  simulation  study  of  the  use  of  a  simple  non-linear  prediction 
algorithm  to  compensate  for  lags  occurring  during  high  velocity  step  movements  of  the 
head.  The  algorithm  used  acceleration  data  and  was  reported  to  have  been  successfully 
implemented  in  a  fiber  optic  helmet-mounted  display. 

•  Ref.  1  utilized  an  adaptive  loast-mean-square  predictor  to  predict  pilot  head  look 
direction.  Computer  simulations  showed  that  the  predictor  was  capable  of  good 
predictions  for  input  signals  that  change  their  characteristics  linearly  with  time  (e.g.  a 
.swept  sine  with  decreasing  amplitude)  but  needed  improvement  to  predict  head 
movements  whose  characteristics  change  randomly  with  time. 


-  33  - 


Referencas  (*:  key  referanceis)) 


1.  Albrecht  (1989) 

3.  List  (1983) 

5.  So  and  Griffin  (1991b) 

7.  Sobiski  and  Cordullo  (1987) 


2.  Bernard  and  Smith  (1984) 
4.  So  and  Griffin  (1S91a) 

•6.  So  and  Griffin  (1992) 


I 


I 

i 


6.1,5  Lag  compensation  by  in^age  deflection  and  head  position  prtidiction 
General  description 

Images  on  a  head-coupled  system  are  positioned  incorrectly  due  to  display  lag  (see 
Section  6.1.1  for  details  of  lag-induced  position  error).  By  deflecting  the  lagged  image  to 
the  currently  correct  angular  position,  the  image  maintains  correct  correspondence  with 
the  outside  world.  The  principle  of  the  image  deflection  technique  is  explained  in  Method 
Section.  Image  deflection  significantly  improved  two  dimensional  head  tracking 
performance  in  the  presence  of  imposed  display  lags  (up  to  380  ms,  system  display  lag 
was  40  ms)  and  performance  was  restored  to  that  without  an  imposed  lag  (Figures  6.20 
and  6.21).  The  amount  of  image  deflection  required  to  compensate  for  the  display  lags 
increased  with  .nc'easing  lag  (Figure  6.22).  The  image  deflection  reduced  the  fiold-of-view 
and  introduced  parallax  errors  (see  Method  Section).  Both  were  expected  to  degrade 
tracking  performance  although  their  effects  were  not  apparent  in  the  tracking 
measurements  (Figure  6.20).  The  explanations  reported  were:  (i)  images  used  were  not 
in  three  dimensional  perspective,  therefore  parallax  error  did  not  affect  the  image  quality 
and  (ii)  the  target  was  always  captured  near  the  center  of  the  fieid-of-viow,  therefore 
reduction  of  the  field  of-view  had  little  effect  on  the  perception  of  the  target.  For  imposed 
display  lags  less  than  280  ms,  the  use  of  a  simple  head  position  prediction  algorithm 
significantly  reduced  the  amount  of  image  deflection  required  (Figure  6.22)  and  would 
therefor  reduce  parallax  errors  and  reductions  of  the  field-of-viow.  The  principle  of  the 
simple  head  position  prediction  algorithm  is  illustrated  in  Table  6.1 . 

Applications 

Design  of  h  jad-coupled  simulator. 

Methods  (ref.  5) 

Test  conditions 

•  Mean  radial  head  tracking  error  and  subjective  difficulty  rating  were  measured  with 
different  imposed  display  lags  (0  ms  to  380  ms,  system  display  lag  was  40  ms),  with  and 
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without  image  deflection,  and  with  and 
without  head  position  prediction. 

•  The  amount  of  deflection  used  to 
compensate  for  different  imposed  display 
lags  was  measured. 

•  The  target  motions  used  in  both  pitch 
and  yaw  axes  were  random  signals 
integrated  twice  and  band-pass  filtered 
between  0.01  and  0.63  Hz.  The  duration 
was  60  seconds. 

Experimental  details 


Figure  6.20  Mean  radial  head  tracking  error 
with  different  display  lags  and  3  lag 
compensation  techniques  (median  of  12 
subjects,  adapted  from  ref.  5i. 


•  Independent  variables:  display  lag,  lag  compensation  by  image  deflection,  head  position 
prediction  and  combined  image  deflection  with  head  position  prediction. 


•  Dependent  variables:  mean  radial  head 
tracking  error,  subjective  difficulty  rating 
and  the  amount  of  image  deflection. 

•  Subject's  task:  track  a  moving  target 
with  a  reticle.  Both  the  target  and  the 
reticle  were  presented  on  a  monocular 
helmet-mounted  display  at  optical  infinity. 
The  reticle  was  presented  at  the  center  of 
the  display. 

•  Twelve  male  subj.icts  participated.  They 
were  either  students  or  researchers. 


Utl 

^  l«gj»def iBction+prediction 


/ 


/  / 
<V^' 


100 


200 


300 


Addi.tion«I  Tinw  Delay*  (m*) 

RflCing; 

0  -  not  difficult  3  -  difficult 

I  ■  «  Litcl*  difficult  4  «  very  diffii'"lL 

1  -  fiirly  difficult  5  -  pxci«t*»lv  difficult 


Figure  6.21  Subjective  difficulty  rat  ng 
with  different  display  lag-’  and  3  1 'g 
compensation  techniques  (r  idian  of  12 
subjects,  adapted  from  rnf.  5). 
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Technical  details 


•  Image  deflection:  benefits 
The  visual  effect  of  display  iag,  and  the 
benefits  of  image  deflection  on  a  head- 
coupled  image  is  illustrated  in  Figure  6.23. 
Although  computer-generated  images  were 
used  in  all  the  studies  reviewed,  a  head- 
slaved  camera  is  used  for  illustration. 
Figure  6.23  shows  the  effect  on  the 
displayed  image  when  the  head  of  an 
operator  moves  to  acquire  a  statioriary 
target  at  a  constant  angular  velocity,  6^, 
assuming  the  head-slaved  camera  follows 
with  a  constant  time  delay,  r.  After  a 
time,  t.  the  head  has  traveled  an  angle  of 


no  prediction 
•  with  prediction 


100  200  300 
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Figure  6.22  The  amount  of  image 
deflection  used  to  compensate  for  different 
display  lags  with  and  without  head  position 
prediction  (median  of  1 2  subjects,  adapted 
from  ref  5). 


e,  =  d,t  (1) 

but  the  camera  and  images  captured  have  only  moved  to  d^,  where 
“  0,  -  e,r  (2) 


Therefore,  by  deflecting  the  screen  with  an 
offset  of  d^T,  the  image  is  restored  to  its 
correct  position. 

•  deflection:  reduction  in  fi  jId-Qf- 

view 

Suppose  the  target  is  separated  from  the 
initial  head  position  by  an  angie,  t?„,  and 
that  the  field-of-view  (FOV)  of  the  camera 
subtends  an  angle  of  (p.  The  image  of  the 
target  will  only  be  captured  if  it  falls  within 
the  FOV  of  the  camera: 
i.e.  -  9c  ^ 
substituting  6^  from  (2): 


Table  6.1  The  simple  haad  position 
prediction  algorithm  (adapted  from  ref.  5). 


H(t+n)  -  H(t)  +  (htid  velocity)  x  (n) 


where 

H(l;  ^ 

head  velocity  (insuntencoux)  *  — - - 

Key; 

H(t)  -  meesurtd  heed  poiltlon  ti  tlrn*.  t  mi 
n  "  prediction  time  (ini) 

H(t+n)  ••  predicted  heed  position  et  (t  +  n)  m* 
20  ms  (sampling  ptiiod) 
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0c.  -  0A  +  ^  (4) 

If  we  arrange  equation  (4),  we  get: 

d„  '  0,  :<  -  20,r;/2  (5) 

where  {ip  -  20^^)  is  defined  as  tha  effectivo 
FOV,  which  is  two  times  the  maximum 
angular  separation  allowable  between  the 
target  and  the  observer's  line-of-sight  so 
that  the  target  will  fall  within  display. 

From  equation  (5),  one  can  see  that  this 
effective  FOV  is  reduced  by  any  time  delay 
(r). 

Results  (ref.  5) 

s  The  image  deflection  technique  (both 
with  and  without  head  position  prediction) 


Figure  6.23  Illustration  of  effects  of  lags 
between  head  movement  and  image 
movement  on  images  captured  by  a  head- 
slaved  camera.  The  effect  of  image 
deflection  is  also  shown  (adapted  from 
ref.  5). 


significantly  reduced  radial  error  and 
improved  the  subjective  difficulty  rating  (Figures  6.20  and  6.21 ).  This  is  confirmed  by  the 
results  of  the  Friedman  two-way  analysis  of  variance  by  ranks. 


•  The  amount  of  deflection  required  to  com,  msate  for  the  lags  in  the  yaw-axis  inc  eased 
with  increasing  imposed  display  lags  (Figure  6.22).  Tha  result  in  the  pitch-axis  was  similar 
but  is  not  shown  here. 


•  The  simple  head  position  prediction  algorithm  (Table  6.1)  was  shown  to  reduce  the 
amount  of  deflection  used  in  both  the  pitch  and  yaw  axes  (the  pitch-axis  data  is  shown 
in  Figure  6.22). 


Comparison  with  other  studies 


•  Ref.  1  reported  the  use  of  an  image  deflection  technique  to  compensate  the  Ian  in  a 
head-coupled  visual  loop  of  a  head-coupled  simulator.  The  simulator  used  a  dome  screen 
with  head-coupled  projector  rather  than  a  helmet-mounted  display,  thorofore  the  restriction 
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in  tho  field'Of-viBw  was  not  important.  Detailed  description  of  the  deflection  technique 
used  was  included  in  ref.  1  and  it  was  patented  {ref.  2),  however  no  human 
experimentation  was  reported. 

•  The  simple  head  position  algorithm  used  in  ref.  5  was  replaced  with  phase  lead  filters 
(ref.  6).  With  imposed  display  lags,  similar  head  tracking  performance  was  obtained  with 
less  reduction  in  the  field-of-viaw  and  parallax  error  as  compared  to  the  results  in  ref.  5. 
These  filters  were  optimized  to  produce  time  leads  in  the  frequency  range  0  to  0.6  Hz. 

Constraints 

•  Studies  were  conducted  in  laboratory  environments.  The  benefits  of  lag  compensation 
by  combined  head  position  prediction  and  image  deflection  in  operational  head-coupled 
simulator  should  be  investigated. 


References  (*:  key  reference(s)) 
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4.  So  and  Griffin  (1 991a) 
“e.  So  and  Griffin  (1992) 
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6.2  Head-slaved  weapon  control  loop 


A  block  diagram  showing  a  head-slaved  weapon  control  loop  within  a  simulator  is  shown 

I 

j  in  Figure  4.8.  This  loop  provides  the  position  control  of  a  head-slaved  device  and  feeds 

j  back  this  position  in  terms  of  the  position  of  a  reticle.  The  variables  investigated  in  this 

section  include  head  reticle  lag  and  the  visual  feedback  of  the  position  of  a  head-slaved 
j  device  lagging  behind  the  line-of-sight. 

.  t 
J 

6.2.1  Reticle  lag 

.a' 

■  I 

i  General  description 

In  addition  to  presenting  information  to  operators,  head-coupled  systems  can  be  used  for 
J  aiming  and  target  designation.  One  such  application  will  be  the  head-slaved  turret  gun  in 

\  I  a  combat  helicopter;  as  a  pilot  turns  his  oi  her  head  to  track  the  target,  the  gun  follows. 

The  Instantaneous  position  of  the  head-slaved  gun  may  be  displayed  as  a  reticle  on  a 

I 

I  helmet-mounted  display  (HMD).  Due  to  the  inevitable  lag  in  the  head-slaved  device  (turret 

■  .‘i 

’  gun),  the  reticle  will  always  lag  behind  the  head-pointing  angle.  Hence,  the  lag  has  been 

j  referred  to  as  'reticle  lag'.  Tracking  performance  with  a  head-slaved  device  was  found  to 

I  be  significantly  degraded  by  lags  greater  than,  or  equal  to,  80  ms  (Figure  6.24,  the  system 

'  has  a  40  ms  display  lag  and  no  reticle  lag).  With  head  tracking  transfer  function 

I  measurements,  it  was  reported  that  as  the  lag  increased,  the  subject  decreased  his  gain 

from  unity  and  the  phase  lag  became  larger  which,  in  turn,  increased  the  tracking  error 

(Figure  6.25). 

i 

1 

I  Applications 

i-  I 

"  I 

Design  of  head-slaved  devices. 

Methods  (ref.  2) 

I 

I 

i 

Test  conditions 

I 

•  Mean  radial  tracking  error  and  head  tracking  transfer  functions  were  measured  with 

j 
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different  reticle  lags  (0  ms  to  400  ms). 

The  system  had  a  40  ms  display  lag  and 
no  reticle  lag. 

•  The  target  motions  used  in  both  pitch 
and  yaw  axis  were  random  signals 
integrated  once,  high-pass  filtered  at 
0.01  Hz  (24  dB/octave)  and  low-pass 
filtered  at  1.2  Hz  (120  dB/octave). 

Figure  6.24  Mean  radial  error  in  degree  with 
Experimental  details  different  reticle  lags  (median  of  8  trials,  1 

subject,  adapted  from  ref.  2). 

•  Independent  variable;  reticle  lag. 

•  Dependent  variables:  mean  radial  error  and  head  tracking  transfer  function. 

•  Subject's  task:  track  a  moving  target  with  a  head-slaved  reticle.  Both  the  target  and  the 
reticle  were  presented  on  a  monocular  helmet-mounted  display  at  optical  infinity.  The 
reticle  had  an  open  cross  shape  with  an  inner  diameter  of  1 .2  degrees. 

•  One  mala  subject  participated.  Eight  trials  were  recorded. 
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Figure  G.25  Head  tracking  transfer  functions  in  the  yaw- axis  with  different  reticle  lags 
(average  of  8  trials,  1  subject,  adapted  from  ref.  2). 
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Results  (ref.  2) 


•  Muan  radial  error  increased  significantly  for  reticle  lags  greeter  than,  or  equal  to,  80  ms 
(p<0.05,  Wilcoxon  matched-pairs  signed  ranks  tests). 

•  Head  tracking  transfer  functions  in  the  yaw-axis  are  shown  in  Figure  6.25.  The  transfer 
functions  in  the  pitch-axis  were  similar  and  are  not  shown.  As  the  lag  increased,  the 
subject  decreased  his  gain  from  unity  and  the  phase  lag  became  larger  which,  in  turn, 
increased  the  tracking  error. 

Comparison  with  other  studies 

•  Figure  6.25  (ref.  1)  indicated  that  mean  radial  head  tracking  error  increased  with 
increasing  reticle  lag.  However,  i  threshold  lag  was  not  reported.  The  experimental  head- 
coupled  system  used  in  ref.  1  was  different  from  that  used  in  ref.  2  (see  Table  5.1, 
Section  5.0).  8  male  subjects  were  used  in  ref.  1. 


•  Ref.  1  reported  that  with  imposed  reticle 
lags  greater  than,  or  equal  to,  80  rns,  head 
tracking  performance  improved  when  the 
visual  feedback  in  the  form  of  a  reticle 
lagging  behind  the  operator's  line-of-sight 
vas  removed. 

Constraints 

•  OrilY  one  male  subject  was  used  in 
ref.  2. 

References  (*:  key  refarance(s)) 

1.  Eyre  and  Griffin  (1992) 

2.  So  and  Griffin  (1991a) 
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Figure  6.26  Mean  radial  tracking  error  with 
different  reticle  lags  (Median  of  8  subjects, 
adapted  from  ref.  1 ). 


6.3  Manual  control  loop 


A  block  diagram  showing  a  manual  control  loop  within  a  simulator  is  shown  in  Figure  4.8. 
The  variables  investigated  in  this  section  are  as  follows: 

(i)  manual  display  lag  (Section  6.3.1); 

(ii)  time  lead  with  lag  (Section  6.3.2); 

(iii)  lag  in  motion  cue  presentation  (Section  6.3.3). 

Sections  6.3.1  to  6.3.2  concern  the  effects  of  time  delay  variables  whilst  Section  6.3.3 
concerns  the  related  effects  of  a  simulator  hardware  variable. 

6.3.1  Manual  display  lag 

General  description 

In  the  manual  control  loop  of  a  head-couplod  system,  lags  occur  between  the  input  from 
a  hand  controller  and  the  resultant  change  in  the  visual  output.  Similar  lags  occur  in 
manual  control  systems  with  panel-mounted  displays  and  their  effects  have  been  the 
subject  of  many  studies  (transmission  lag,  Boff  and  Lincoln  (1988),  Warrick  (1949); 
simulator  delay,  Riccio  et.  a!  (1987);  system  transport  delay,  Gum  and  Albey  (1977)). 

In  a  head-couplod  system,  tills  type  of  lag  has  previously  been  referred  to  as  'throughput 
lag'.  Since,  like  display  lag,  it  affects  the  orientati  m  of  the  entire  vi.sual  field,  this  type  of 
lag  will  hereafter  be  ref)-jrred  to  as  'manual  display  lag'.  If  a  head-coupled  system  is  used 
as  a  helicopter  simulator,  as  the  manual  display  lag  increases,  the  Cooper-Harper  rating 
increases,  so  indicating  degradation  of  helicopter  siinuiated  handling  qualities  (Figures  6.27 
and  6.28). 


Applications 

Design  of  hoad-coupled  simulators  and  tele-operated  vehicle  system. 
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Figure  6.27  Cooper-Harper  rating  (adapted  from  ref.  1  and  Cooper  and  Harper,  1 969). 


Methods 

Test  conditions  (ref.  1) 

•  Simulated  helicopter  maneuvers;  narrow 
slalom  or  dolphin  (high  speed),  serpentine 
(low  speed-hover)  and  longitudinal  quick 
stop  (transition  between  high  and  low 
speed). 

•  Task  evaluation  with  Cooper-Harper 
rating  were  taken  with  different  manual 
display  Inga  (87  ms  to  254  ms). 

Experimental  details  (ref.  1 ) 
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Figure  6.28  Effects  of  manual  display  lags 
on  Cooper-Harper  ratings  with  three  types 
(  ,  ,  )  of  flight  manoeuvres  (Median  of  4 

subjects,  adapted  from  ref.  1 ). 


•  Independent  variables:  helicopter  maneuver  and  manual  display  lag. 
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•  Dependent  variables:  subjective  evaluation  of  the  task  with  Cooper-Harper  rating. 


•  Subject's  task:  fly  a  simulated  high  performance  helicopter  in  three  types  of  maneuver. 
Each  maneuver  took  approximately  40  minutes. 

•  Four  former  military  helicopter  pilots  participated.  Their  total  flight  time  ranged  from 
2650  to  7300  hours. 

Results  (ref.  1 ) 

•  It  was  found  that  with  increased  manual  display  lag  the  Cooper-Harper  rating  increased 
indicating  degradation  in  perceived  handling  qualities  (Figure  6.28). 

•  For  the  types  of  helicopter  simulated,  there  was  not  a  definite  manual  display  lag  at 
which  the  ratings  changed  abruptly. 

References  (*:  key  reference(s)) 

•1.  Woltkamp  et.  al  (1988) 

Cross  references 

Ref.  1  m  Section  6.1 .3.  Effects  of  an  exponential  display  lag  on  simulated  helicopter  flight 
path  estimation  tasks  with  head-coupled  systems. 
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6.3.2  Time  lead  with  manual  display  lag 


During  this  literature  survey,  few  published  studies  concerned  with  the  effects  of  lag 
within  the  manual  control  loop  of  a  head-coupled  system  were  found  and  only  one  of  them 
dealt  with  lag  compensation  by  prediction  (Friedmann  et.  at,  1992).  Although  time 
histories  indicating  the  potential  benefits  of  lag  compensation  by  a  Kalman  filter  were 
shown  in  that  study,  no  objective  data  such  as  tracking  error  or  time-on-target  were 
reported.  This  approach  to  lag  compensation  in  a  manual  control  loop  with  a  panel- 
mounted  display  has  been  the  subject  of  many  studies.  Various  methods  have  been 
proposed  to  improve  the  perforniance;  single  interval  lead  filters,  Taylor  series 
extrapolations,  trapezoidal  integration  algorithm  and  split-path  non-linear  filters.  They  have 
been  tested  in  manual  simulation  environments  and  the  results  have  been  published  in  Gum 
and  Albery  (1977),  Malone  and  Horowitz  (1987),  McFarland  (1988),  Jewell  and  Clement 
(1987)  and  Hess  and  Myers  (1985). 

It  is  the  intention  of  this  review  to  concentrate  on  the  effect  of  lags  within  head-coupled 
systems.  Therefore,  detailed  reviews  of  the  above  studies  have  not  been  included  in  this 
section.  Brief  summaries  of  some  of  the  references  mentioned  above  are  attached  as 
Appendix  a. 

6.3.3  Lags  in  motion  cue  presentation 

As  with  Section  6.3.2,  no  published  study  which  dealt  with  the  effects  of  lags  in  manual 
controlled  motion  cues  within  a  head-coupled  system  was  found.  Similar  effects  of  lags 
in  motion  cue  presentation  within  a  manual  control  loop  with  a  panel-mounted  display  have 
been  the  object  of  several  studies.  Boff  and  Lincoln  (1988)  have  reviewed  studies 
concerned  with  the  effect  of  temporal  mismatch  of  motion  and  visual  displays  on 
continuous  tracking  with  simiilatRd  aircraft  dynamics.  Millar  and  Riley  (1976)  reported  that 
as  task  difficulty  increased,  the  amount  of  acceptable  time  delay  between  visual  and 
motion  cues  decrea.ses.  The  task  difficulty  was  quantified  by  the  Cooper-Harper  aircraft 
handling  quality  ratings  and  the  target  frequency  content. 

Detailed  reviews  of  the  above  studies  have  not  been  included  in  this  section.  Brief 
summaries  of  some  of  the  references  mentioned  above  are  attached  as  Appendix  B. 
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6.4  Eye-coupled  visual  loop 


A  block  diagram  showing  an  eye-coupled  visual  loop  within  a  simulator  is  shown  in 
Figure  4.8.  This  loop  could  provide  an  eye-slaved  high  resolution  insert  that  blends  into 
the  visual  field  of  the  simulator.  The  variable  investigated  in  this  section  is  eye-display  lag 
(Section  6.4.1 ). 

6.4.1  Eye-display  lag 

General  description 

In  a  simulator,  the  concept  of  using  an  eye-slaved  high  resolution  graphic  insert  in  a  low 
resolution  background  has  been  developed  to  provide  an  image  scene  of  high  detaii  and 
resolution  at  a  reasonable  cost  and  speed  (ref.  2).  This  insert  has  previously  bean  referred 
to  as  eye-slaved  area  of  interest  (AOI,  refs.  1 ,  3  and  4).  Two  different  approaches  have 
been  taken  to  implement  this  concept.  The  first  approach  was  to  project  the  insert  on  the 
inside  of  a  dome  or  flat  display  screen  (ref.  1 ).  The  second  approach  was  to  present  the 
insert  on  a  wide  fieid-of-view  helmet-mounted  display  (refs.  3  and  4).  The  structure  of 
various  simulators  with  eye-slaved  insert  can  be  found  in  Table  5.1 ,  Section  5.0.  In  both 
implementations,  lags  occur  between  the  onset  of  head  and  eye  movement  and  the 
morr\ent  at  which  the  eye-slaved  insert  responds.  The  sources  of  this  lag  include  eye- 
tracker,  head  tracker,  computer  image  generation  and  servo  driven  mirror  assembly  that 
steer  the  insert  optically  (refs.  1 , 3  and  4).  Such  a  lag  will  hereafter  be  referred  to  as  'eye- 
display  lag'.  The  effect  of  eye-display  lags  on  a  combined  target  identification  and  manual 
control  task  was  studied  (ref  1 ).  With  an  imposed  eye-display  lag  less  than,  or  equal  to, 
50  ms  (system  eye-display  lag  was  140  ms),  little  performance  variation  was  observed. 
Beyond  50  ms,  performance  degraded  appreciably  (ret.  1).  To  locate,  aim  and  recognize 
a  target  with  saccadic  eye  movements,  an  imposed  eye-display  lag  of  50  ms  had  only  a 
minor  effect  on  aiming  accuracy,  however  the  number  of  target  recognized  was  reduced. 


Applications 


Development  of  nye  slaved  high  resolution  graphic  inserts  in  head-coupled  simulators. 


-  47  - 


Methods  (ref.  1 ) 


Two  studies  from  ref.  1  are  reviewed  here.  The  head-coupled  system  used  was  the  Eye- 
Slaved  Projector  Raster  Inset  (ESPRIT)  visual  test  bed  (see  Table  5.1 ,  Section  5.0).  The 
system  eye-display  lag  reported  was  1 40  ms  and  extra  eye-display  lags  were  additional  to 
this  140  ms  eye-display  lag.  The  ESPRIT  system  comprised  a  flat  display  screen,  a  fixed 
background  projector,  a  control  stick,  a  graphics  image  generator,  a  helmet  with  integrated 
head  and  eye  tracker  and  an  eye-slaved  insert  projector.  The  background  image  resolution 
was  1 1  minutes  of  arc  and  its  field-of-view  (FOV)  was  76°  .v  64®. .  The  eye-slaved  insert 
had  a  resolution  of  2.5  minutes  of  arc  and  a  FOV  of  18°  (circular). 

Test  conditions  (study  1 ) 

•  Detailed  performance  measurements  were  not  reported.  However,  they  were  likely  to 
be  manual  tracking  error  and  target  recognition  error  with  different  imposed  eye-display 
lags  (0  ms  to  1  50  ms.  in  addition  to  the  system  eye-display  lag  of  140  ms). 

•  The  eye-slaved  insert  size  was  set  to  IS  degrees  (circular). 

Experimental  details  (study  1 ) 

•  Independent  variable:  imposed  eye-display  lag. 

•  Dependent  variables:  overall  performance  (it  may  consist  of  manual  tracking  error  and 
target  recognition  error). 

a  Subject's  task:  manually  steer  a  simulated  aircraft  through  a  narrow  canyon.  The 
aircraft's  altitude  and  speed  were  fixed  and  lateral  steering  was  controlled  by  subjects. 
A  drift  factor  wa.s  introduced  to  add  some  difficulty  to  the  task.  The  canyon  had  a  narrow 
path  on  it's  floor  for  the  aircraft  to  follow,  randomly  placed  targets  and  decoys  were 
presented  along  the  canyon  for  target  detection  and  identification.  A  picture  of  the  canyon 
is  shown  in  Figure  6.29. 

•  Twenty  subjects  participated.  Some  of  whom  were  pilots. 
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Test  conditions  (study  2) 


•  Target  acquisition  time,  reading  (fixation)  time  for  each  target,  and  target  recognition 
error  were  measured  with  different  imposed  eye-display  lags  (0  ms  to  50  ms,  in  addition 
to  the  system  eye-display  lag). 


Experimental  details 
(study  .?) 

*  Independent  variable:  imposed  eye- 
display  lag. 

•  Dependent  variables;  target 
acquisition  time;  target  reading 
(fixation)  time  and  recognition  error. 


Figure  6.29  Canyon  with  textured  floor  and 
walls,  presented  on  the  ESPRIT  system,  adapted 
from  ref.  1 . 


•  Subject's  task;  locate  a  target, 

identify  the  target,  and  then  'ook  to  the  next  target  rapidly.  Each  target,  if  properly 
recognized,  would  provide  information  needed  for  the  next  saccade.  Targets  were 
presented  at  the  four  corners  of  the  flat  display  screen.  Each  target  provided  a  short  radial 
line  pointing  towards  the  next  target  (Figure  6.30). 


•  Twenty-six  subjects  participated.  Some 
of  whom  were  p..3ts. 


Results  o  =  Largt^L 

C  =  radial  line 

•  With  an  imp  .odd  eye-display  lag  less 

than,  or  equal  to,  50  ms  (system  eye-  i^l 

display  lag  was  1 40  ms),  little  performance  — ' - ' — 

variation  was  observed.  Beyond  this  level,  „ 

Figure  6.30  Oiagrammatic  illustration  of 

performance  degraded  appreciably  (ref.  1 ).  the  target  co.  guration  for  study  2,  adapted 

from  ref.  2. 

•  To  locate,  aiin  and  recognize  a  target  with  saccadic  eye  movements,  an  imposed  eye- 
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display  lag  of  50  ms  had  only  a  minor  effect  on  aiming  accuracy,  however  the  number  of 
targets  recognized  was  reduced  (see  subject's  task  for  the  meaning  of  a  properly 
recognized  target). 

Constraints 

•  No  measurements  or  statistical  data  were  shown  in  ref.  1 . 

References  (*:  key  referencefs)) 

•1.  Browder  and  Chambers  (1988) 

2.  Eyre  and  Griffin  (1992) 

3.  Geltmacher  (1988) 

4.  Lypaczewski  et.  a/ (1987) 

5.  Longridge  et.  at  (1990) 
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6.5  Eya>s3aved  waapon  control  loop 


A  block  diagram  showing  an  ey  . -slaved  weapon  control  loop  within  a  simulator  is  shown 
in  Figure  4.8.  This  loop  enables  the  position  control  of  an  eye-slaved  device  and  feeds 
back  this  position  as  a  reticle  presentation.  The  variables  investigated  in  this  section 
include  eye-reticle  lag  and  the  visual  feedback  of  the  position  of  an  eye-slaved  device 
lagging  behind  the  gaze  angle. 

6.5.1  Eye-reticia  lag 

General  description 


Similar  to  a  head-slaved  weapon  (Section  6.2),  lags  occur  in  controlling  an  eye-slaved 
weapon.  The  position  of  an  eye-slaved  weapon  is  fed  back  to  an  operator  as  a  reticle 
lagging  behind  the  gaze  angle.  Such  a  lag  has  previously  been  referred  to  as  reticle  lag 
(refs.  1  and  2)  and  will  hereafter  be  referred  as  'eye-reticle  lag'.  Figure  6.31  shows  a 
diagrammatic  illustration  of  the  apparatus  during  the  study  in  ref.  1 .  With  a  two 
dimensional  band-limited  random  tracking  task,  mean  radial  tracking  error  increased  with 
increasing  eye-reticle  lag  (Figure  6.32).  It  is  possible  to  withdraw  the  iye-slaved  reticle 
feedback,  in  which  case  an  operator  will  track  in  an  open-loop  fashion.  That  is,  despite 
the  lag  in  the  dynamic  response  of  an  eye-slaved  weapon,  an  operator  will  track  a  target 
as  if  no  lags  existed.  Although  there  will  be  no  visual  indication  for  the  eye-reticle  lag, 
such  lag  remains  and  affects  the  tracking  performance  of  an  eye-slaved  weapon.  This  lag 
will  be  referred  to  as  a  'dynamic  response  lag',  it's  magnitude  will  be  the  same  as  that  of 
the  eye-reiticle  lag.  It  was  found  that  for  imposed  eye-reticle  lags  of  160  ms  and  below, 
the  presentation  of  a  reticle  degrades  eye  tracking  performance.  For  eye-reticle  lags 
greater  than  1 60  ms  and  up  to  320  ms,  no  significant  difference  in  tracking  performance 


with  and  without  leiicie  presentation  was  found.  The  system  eye-reticle  lag  was  60  ms. 


Applications 


Design  of  eye-slaved  devices  and  their  visual  interfaces  with  operators. 
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Test  ':onditiorts 

•»  Mean  radial  eye  tracking  error 
measured  with  different  impowd  eye- 
reticle  lags  (0  ms  to  320  ms.,  with  a 
system  eye-reticle  display  lag  of  60  msl. 

•  Subjects  were  asked  to  track  a  target 
with  their  eyes  without  an  ey«-reticle,  eye 
displacement  time  histories  in  both  pitch 
and  yaw  axes  were  measured.  Lags  from 
0  ms  to  320  ms  were  added  to  these  time 
histories  and  mean  radiai  tracking  errors 
were  calculated  with  reference  to  the 
target  motion  time  history. 


•)  K'O  -'W 
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Figure  6.32  Mean  radial  eye  tracking  error 
with  different  eye-reticle  lag  (a  curve  fitting 
was  also  shown,  adapted  fiom  ref.  2i. 
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•  Ths  target  motions  used  in  both  pitch  and  yaw  axes  were  random  signals  band-pass 
filtered  between  0.01  and  2.0  Hz  (60  dB/octave  roll-off).  The  duration  was  1 20  seconds. 

Experimental  details 

•  Independent  variables:  eye-reticle  lag,  eye-reticle  feedback  and  lag  within  an  eyo-.slaved 
weapon  control  loop  (dynamic  response  lag)  when  no  eye-reticle  was  used. 

•  Dependent  variables:  eye  displacement  time  history  and  mean  radial  eye  tracking  error. 

®  Subject's  task:  track  a  moving  target  with  an  eye-slaved  reticle  or  the  gaze.  Both  the 
target  and  the  reticle  were  presented  on  a  binocular  helmet-mounted  display  at  optical 
infinity.  The  reticle  had  a  2“  radius. 

•  Ten  male  subjects  participated.  They  were  either  students  or  researchers. 

Re&uhs  (ref.  2) 

e  Mean  radial  eye  tracking  error  increased  with  increasing  eye-reticle  lag  (Figure  6.32). 

•  Without  reticle  feedback,  mean  radial  eye  tracking  error  increased  with  increasing 
dynamic  rasponise  lag  of  an  eye-slaved  weapon  (Figure  6.32). 

•  With  dynamic  response  lags  less  than,  or  equal  to,  1 60  ms,  there  was  a  significant 
degradation  in  tracking  performance  with  the  addition  of  an  eye-slaved  reticle  (p<0.01, 
Wilcoxon  matched-pair  signed  ranks  two-tailed).  The  system  eye-reticle  lag  was  60  ms. 

•  For  the  additiorr  of  lag.?  greater  than  1 60  nos  and  up  to  320  ms,  no  significant  difference 
in  tracking  porformance  witli  and  without  reticle  presentation  was  found. 

Constraints 

•  These  findings  may  only  apply  whan  the  target  motion  is  band-limited  random. 
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•  Only  continuous  eye  tracking  was  studied.  The  effect  of  eye-reticle  lag  on  tasks,  such 
as  target  acquisition,  was  not  inve.stigated. 

Reference*  (*:  key  referencefs)} 

*1.  Eyre  and  Griffin  (1991)  2.  Eyre  and  Griffin  (1992) 
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7.0  PREVIOUS  RESEARCH  ON  INTERACTIONS  AMONG  LAGS  IN  VARIOUS  FEEDBACK 


LOOPS 

A  survey  of  literature  has  been  conducted  concerning  the  effects  of  interactions  among 
lags  in  head-coupied  simulators.  The  results  are  shown  in  Table  7.1. 

Table  7.1  List  of  references  concerning  effects  of  lags  in  a  head-coupled  simulator 


L»e 

•ourc* 

h«iitd>coupM  vliusl  kMp 

h«Ml*alaviMl 

maoual  control  toop 

•yo<coupl*d 
vituot  loop 

•/•■•lavad 

vwapon 
control  loan 

CtQ 

hP3 

PLtfV 

ratkhi 

■tiek 

nation 

CUfil 

•y«  viouoi 
Iniert 

•V«  rotiolo 

cia 

X 

3.9 

1.4 

Hre 

X 

4  8 

3.5.9 

2 

1.4 

FUR/ 

cirTMrfl 

X 

6 

«.8 

4.8 

X 

•tick 

3.9 

3.5.9 

5 

X 

6.7 

motkin 

6.7 

X 

visuBi 

Iniift 

2 

2 

X 

1.4 

1.4 

X 

1 .  Barnes  (1990) 

3.  Held  (1990) 

5.  Grunwald  et.a!  (1991) 

7.  Reid  and  Nahon  (1987)* 
9.  William  (1987) 


2.  Browder  and  Chambers  (1988) 
4.  Eyre  anc  Griffin  (1992) 

6.  Miller  and  Riley  (1976)* 

8.  So  and  Griffin  (1991a) 


'  studies  with  panel-mounted  display 

More  than  100  papers  concerning  the  effects  of  lags  within  head-coupled  systems  were 
found.  Most  of  the  studies  involved  more  than  one  lag  source,  but  only  a  few  investigated 
the  interactions  between  individual  lags. 
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8.0  GENERAL  DISCUSSION,  CONCLUSIONS  AND  RECOMMENDATIONS 


8.1  Effects  of  variables  within  a  head-coupiad  visual  loop 

8.1.1  General  discussion 

Head-coupled  systems  enable  an  operator  to  view  continuously  information  appropriate  to 
the  instantaneous  iine-ol-sight  of  the  head.  However,  head-coupled  imarje  movements 
suffer  lags  in  their  responses  to  head  movements  {display  lag).  This  type  of  lag  causes  a 
head-coupled  image  to  be  positioned  incorrectly  on  a  helmet-mounted  display.  This 
position  error  has  been  shown,  both  theoretically  and  experimentally,  to  increase  linearly 
with  increasing  display  lag  and  target  velocity.  Studies  have  shown  that  as  display  lag 
increased,  head  tracking  performance  decreased.  In  the  light  of  the  experimental  findings, 
it  is  hypothesized  that  with  a  display  lag  within  a  head-coupled  system,  the  degradation 
of  head  tracking  performance  is  mainly  due  to  the  incorrect  target  position  feedback  (i.e. 
position  error). 

Display  lag  compensation  by  image  deflection  has  been  shown  to  be  effective.  However, 
the  associated  parallax  error  and  the  reduction  in  field-of-view  may  degrade  pe»formancB 
when  complex  images  in  throe  dimensional  perspective  are  used.  The  benefits  of  display 
lag  compensatioti  solely  by  head  position  prediction  have  been  found  to  bo  restricted  by 
high  frequency  noise,  perceived  as  jittery  image  movement. 

With  display  lags  up  to  380  ms,  the  combined  use  of  a  simple  head  position  prediction  and 
image  deflection  technique  has  been  shown  to  restore  tracking  perfo.'mance  with  less 
parallax  error,  less  reduction  in  field-of-view  and  smoother  image  movement  than  the  use 
of  either  image  deflection  or  image  prediction  alone.  The  simple  head  position  predictor 
was  replaced  by  several  phase  lead  filters,  and  similar  head  tracking  performance  was 
obtained  wi-h  further  reduction  in  both  the  parallax  errors  and  tha  restriction  of  the  field-of- 
viow.  Those  filters  were  optimized  to  produce  time  leads  over  the  frequency  range  0  to 
0.6  Hz.  So  far.  studies  concerned  with  lag  compensation  by  combined  head  position 
prediction  and  image  detlBClion  have  only  been  conducted  in  laboratory  conditions.  The 
baniafits  of  this  lag  compensation  technique  in  a  simulator  environment  have  yet  to  be 
confirmed. 
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Studies  of  the  effects  of  display  lag  have  been  focused  on  continuous  head  tracking  tasks. 
Other  tasks,  such  as  target  acquisition,  may  need  further  attention. 

With  'search  and  read'  tasks,  e.xponential  display  lags  with  time  constants  of  0.04  second 
or  more  have  been  found  to  increase  reading  time.  The  use  of  combined  head  position 
prediction  and  image  deflection  to  compensate  the  effects  of  exponential  display  lags  has 
not  been  studied. 

8.1.2  Conclusions  and  recommendations 

Lag-induced  position  error  increases  linearly  with  increasing  display  lag  and  target  velocity. 

For  two  dimensional  continuous  hoad  tracking  tasks,  performance  has  been  found  to  be 
significantly  degraded  for  display  lags  greater  than,  or  equal  to,  40  ms  (in  additional  to  a 
system  display  lag  of  40  msl. 

Measurements  of  mean  radial  error  showed  that  the  image  deflection  technique  greatly 
improved  head  tracking  performance  with  display  lag. 

The  amount  of  deflection  needed  to  compensate  for  the  display  lag,  and  the  consequent 
reduction  of  field-of  -view,  increased  in  proportion  to  the  lag.  This  also  introduced  parallax 
errors. 

Mean  radial  head  tracking  errors  were  reduced  by  using  head  position  prediction  with 
phase  lead  filters.  These  filters  were  optimized  to  give  time  leads  over  the  frequi.ncy  range 
0  to  0.6  Hz. 

With  lag  compensation  by  optimized  phase  lead  filters,  the  inevitable  amplifications  at 
frequencies  higher  than  the  prediction  range  introduced  jittery  image  movement.  This  was 
subjectively  disturbing  and  degraded  the  image  quality. 

With  display  lags,  measurements  of  mean  radial  tracking  error  and  subjective  difficulty 
rating  showed  that  combined  image  deflection  and  head  position  prediction  techniques 
greatly  imnroved  tracking  performance  with  less  parallax  error,  less  reduction  of  field  of- 
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view  and  a  smoother  image  muvement. 


Studies  of  the  effects  of  display  lag  have  been  focused  on  continuous  head  tracking. 
Other  tasks,  such  as  target  acquisition,  may  need  further  attention. 

The  benefits  of  lag  compensation  hy  combined  image  deflection  and  head  position 
prediction  in  a  simulator  environment  has  yet  to  be  confirmed. 

With  'search  and  read'  tasks,  exponential  display  lags  with  time  constants  of  0.04  second 
or  more  increased  the  roadirtg  time. 

8.2  Effects  of  variables  within  a  head-slaved  weapon  control  loop 

8.2.1  General  discussion 

Head-couplud  systems  can  be  used  to  search  and  designate  a  target.  One  such  application 
is  the  head-slaved  weapon.  The  in.stantaneous  orientation  of  a  head-slaved  device  can  be 
displayed  as  a  reticle  on  a  helmet-mounted  display.  Due  to  the  lag  in  the  dynamic 
response  of  the  head-slaved  device,  the  reticle  will  always  lag  behind  the  head-pointing 
angle  (reticle  lag).  The  mean  radial  tracking  error  was  found  to  increase  with  increasing 
reticle  lag.  With  reticle  lags  greater  than,  or  equal  to,  80  ms  head  tracking  performance 
improved  when  the  visual  feedback  (in  the  form  of  a  reticle  lagging  behind  the  operator's 
line-of-sight)  was  removed.  However,  this  visual  feedback  may  be  niacessary  while 
performing  operations  such  as  'aim  and  shoot'  tasks,  when  decisions  to  shoot  are  made 
on  the  basis  of  tracking  accuracy.  As  one  of  the  key  references  reviewed  in  Section  6.2 
contains  results  from  only  one  subject,  further  studies  to  confirm  the  finding  are  needed. 
Investigations  have  been  focused  on  continuous  tracking  so  as  to  obtain  head  tracking 
transfer  functions.  However,  one  use  of  a  head-slaved  weapon  will  bo  to  search  and 
designate  a  target.  Studies  to  investigate  the  effect  of  reticle  lag  in  a  target  acquisition 
task  are  required. 

S.2..2  Conclusions  and  recommendations 

Mean  radial  tracking  error  was  found  to  increase  with  increasing  reticle  lag. 
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With  reticle  lags  greater  than,  or  equal  to,  80  ms  head  tracking  performance  improved 
when  the  visual  feedback  (in  the  form  of  a  reticle  lagging  behind  the  operator's  line-cf- 
sight)  was  removed. 

Studies  to  investigate  the  effect  c  reticle  lag  in  a  target  acquisition  task  are  recommended 
as  this  task  represents  a  common  use  of  a  head-slaved  device. 

8.3  Effects  of  variables  within  a  manual  control  loop 

8.3.1  General  discussion 

The  effects  of  lags  on  manual  control  performance  with  panel-mounted  displays  have  been 
the  subject  of  many  studies:  lags  associated  with  control  orders  (Allen  and  Jex,  1 968) 
(Privosnik  et.  a/,  1985),  pure  lags  (Bailey  and  Knotts,  1987;  Ricco  et.  a/,  1987),  modeling 
the  effects  of  lags  (Levison  et.al,  1979;  Levison  and  Papazian,  1987),  lag  compensation 
by  phase  lead  filters  (Crane,  1983),  lag  compensation  by  non-linear  filters  (Hess  and 
Myers,  1985),  lags  in  motion  cues  (Miller  and  Riley,  1976). 

Boff  and  Lincoln  (1 988)  and  Boff  et.  a/  (1986)  have  reviewed  studies  concerned  with  the 
effects  of  lags  on  continuous  tracking  whilst  Merriken  and  Riccio  (1987)  have  reviewed 
studies  concerned  with  the  effects  of  lags  in  flight  simulators. 

In  comparison  with  the  numerous  studies  on  panel-mounted  displays,  there  are  relatively 
few  publications  on  tho  subject  of  the  effect  of  lags  in  manual  control  performance  with 
head-coupled  displays  (manual  display  lag).  Woltkamp  et.  a/  (1 988)  reported  that  manual 
display  lag  degrades  the  perceived  handling  qualities  of  a  head-coupled  helicopter 
simulator.  From  an  engineering  point-of-view,  it  is  expected  that  if  an  operator  keeps  his 
head  stationary  during  a  manual  control  task,  ..he  effects  of  manual  display  lag  si'iouid  he 
similar  to  those  encountered  in  front  of  a  comparable  panel-mounted  display.  However, 
further  studies  are  needed  to  test  this  hypothesis. 

When  an  operator  moves  his  head  during  a  manual  control  task  with  n  head-coupled 
display,  two  types  of  lag  are  present:  manual  display  lag  and  display  lag.  Section  7.0 
summarizes  the  results  of  a  survey  of  published  studies  of  the  interactions  between  these 


-  59  - 


lags  in  a  head-coupled  system.  In  a  head-coupled  sy-stem,  both  the  manual  control  loop 
and  the  head-coupled  visual  loop  enable  an  operator  to  control  the  orientation  of  the  entire 
visual  field.  When  both  loops  are  in  operation,  their  visual  effects  may  not  be 
distinguishable.  For  example,  an  operator  who  pulls  up  the  nose  of  an  aircraft  in  a 
simulator,  may  tilt  the  head  upwards  rather  than  pull  back  the  control  stick.  With  the 
provision  of  adequate  training  this  confusion  may  be  reduced  by  displaying  the  appropriate 
information.  However,  the  presence  of  lags  in  both  control  loops  is  likely  to  escalate  the 
problem.  Some  form  of  lag  compensation  may  be  beneficial. 

8.3.2  Concluoions  and  recommendations 

Manual  display  lag  was  found  to  degrade  the  perceived  handling  qualities  of  a  head- 
coupled  helicopter  simulator. 

Studies  are  recommended  to  tost  the  following  hypothesis:  in  the  presence  of  lags  ir>  both 
the  manual  control  loop  and  the  head-coupled  visual  loop,  an  operator  may  not  be  able  to 
identify  the  visual  feedback  from  an  individual  loop  and  hence  performance  may  be 
degraded. 

8.4  Effect*  of  variables  within  an  eyn-couplad  visual  loop 
8.4.1  General  discussion 

In  head  coupled  simulators,  an  eya-slaved  high  resolution  graphic  insert  to  a  low  resolution 
background  is  frequently  used  to  reduce  the  need  to  compute  a  high  resolution  background 
covering  a  large  fieid-of-view.  Inavitable  lags  occur  between  the  onset  of  a  head  and  eye 
movement  and  the  moment  at  which  an  eye-slaved  insert  responds  (aye  display  lag). 
Imposed  eye  display  lags  greater  than  50  ms  have  been  shown  to  degrade  lateral  manual 
tracking  performance.  The  simulator  had  a  system  eye  display  lag  of  1 40  ms  and  the 
effect  of  the  lag  on  performance  was  unknown.  To  study  the  effect  of  this  lag,  a  system 
with  an  eye  display  lag  of  less  than,  or  equal  to,  50  ms  is  recommended. 

Studies  to  investigate  the  effect  of  eye  display  lag  on  performance  with  continuous 
tracking  tasks  (smooth  pursuit  eye  movement)  and  target  acquisition  tasks  (saccadic  eye 
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movement)  are  recommended. 


In  order  to  compensate  for  the  eye  display  lag,  the  lag  sources  need  to  be  identified.  Eye 
display  lag  is  reported  to  have  been  introduced  in  the  following  processes:  head  position 
measurement,  eye  position  measurement,  computer  image  generation  and  eye-slaved  insert 
projection  (Browder  and  Chamber.  1988).  Although  the  relative  contributions  from  each 
proce.ss  varies  across  different  head-coupled  systems  (Geltmacher,  1 988),  eye  display  lag 
is  mainly  introduced  during  eye  position  measurement  and  computer  image  generation. 
The  prediction  of  the  final  eye  position  of  a  saccadic  eye  movement  has  previously  been 
studied  (Bahill  and  Kallman,  1 983).  The  feasibility  of  applying  lag  compensation  by  means 
of  eye  position  prediction  and  image  deflection  should  be  investigated.  Simulator  variables 
such  as  the  size  of  the  insert  have  been  investigated  and  no  significant  effect  was  reported 
(Brovi/der  and  Chambers,  1 988).  However,  the  combined  effect  of  increasing  eye  display 
lag  and  reducing  eye-slaved  insert  size  have  not  yet  been  studied. 

8.4.2  Conclusions  and  recommendations 

Imposed  eye  display  lags  greater  than  50  ms  have  been  shown  to  degrade  lateral  manual 
tracking  performance. 

To  study  the  effects  of  eye  display  lag,  a  head-coupled  system  with  an  eye  display  lag  less 
than,  or  equal  to,  50  ms  is  recommended. 

Studies  are  recommended  to  investigate  the  feasibility  of  applying  lag  compensation  by 
means  uf  head  position  prediction  and  image  deflection  in  systems  where  eye  display  lag 
is  present. 

8.5  Effects  of  variables  within  an  oye-siaved  weapon  control  loop 
8.5.1  General  discussion 

The  ability  to  use  the  eyes  to  direct  an  aiming  device  towards  a  target  is  of  great  potential. 
However,  lags  occur  in  controlling  an  eye-slaved  weapon.  The  position  of  an  eye-slaved 
weapon  can  be  fed  back  to  an  operator  as  a  reticle  lagging  behind  the  gaze  angle  (eyo- 
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reticle  lag).  Mean  radial  eye  tracking  error  increased  with  increasing  eye-reticle  lag.  With 
eye-reticle  lags,  it  has  been  shown  that  eye  tracking  performance  improved  when  the 
visual  feedback  in  the  form  of  a  reticle  lagging  behind  the  gaze  angle  was  removed. 
Studies  have  been  focused  on  continuous  eye  tracking  (i.e.  smooth  pursuit  tracking).  As 
one  USB  of  a  human  eye  is  to  search  and  locate  a  target,  effects  of  eye-  reticle  lag  on  tasks 
such  as  target  acquisition  should  be  investigated.  Such  tasks  are  likely  to  involve  saccade 
eye  movements,  It  is  hypothesized  that  the  effect  of  eye-reticle  lag  will  be  more  severe 
with  saccadic  eye  movements  than  with  smooth  pursuit  tracking  movements. 

8.5.2  Conclusions  and  recommendations 

Mean  radial  eye  tracking  error  increased  with  increasing  eye-reticle  lag. 

With  eye-reticle  lags,  the  removal  of  the  visual  feedback  in  terms  of  a  reticle  lagging  behind 
the  gaze  angle  was  shown  to  improve  eye  tracking  performance. 

Studies  are  recommended  to  investigate  the  effects  of  eye-reticle  lag  on  a  target 
acquisition  task  so  as  to  test  the  following  hypothesis:  the  effect  of  eye-reticle  lag  will  be 
more  severe  in  irget  acquisition  tasks  (saccadic  eye  movements)  than  during  continuous 
tracking  (smooth  pursuit  tracking). 

8.6  Effects  of  interactions  among  lags  in  various  feedback  loops 
8.6.1  General  discussion 

During  the  period  of  this  research,  tew  published  studies  concerning  the  interactions 
among  the  lags  in  head-coupled  systems  were  found.  Further  review  of  the  literature 
consulted  may  reveal  further  information. 

As  indicated  in  Section  5.0,  a  head-coupled  simulator  consists  of  many  feedback  loops, 
each  with  its  associated  lag.  The  interactions  among  those  Ians  are  unknown  and  may 
cause  performance  degradation  (Section  8.3.1).  However,  studies  to  investigate  these 
interactions  may  be  difficult  as  many  variables  will  be  involved.  To  optimize  the  research 
effort,  modeling  the  effects  of  lags  on  performance  is  required  when  conducting 
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experimental  studies.  Tho  models  should  be  developed  on  the  basis  of  the  following 
assumptions  and  hypothesises:  (i)  in  a  simulator,  most  of  the  lags  affect  an  operator 
through  their  effects  on  the  visual  presentation,  (ii)  with  an  imposed  lag,  the  degradation 
of  performance  is  mainly  due  to  the  lag-induced  incorrect  visual  feedback  (Section  8.1.1) 
and  (iii)  the  effects  of  the  individual  lags  o.i  performance  can  be  linearly  combined  with 
appropriate  weightings  for  each  effect.  Assumptions  (i)  and  (ii)  can  be  tested  with 
laboratory  experiments.  For  example,  with  display  lags  and  reticle  lags,  the  affects  on 
performance  can  b  described  in  two  stages:  (a)  the  lag-induced  position  errors  in  target 
or  reticle  movements  and  (b)  the  effects  of  these  position  errors  on  performance. 
Assuming  there  is  no  interaction  between  the  two  lags,  their  combined  effects  on 
performance  can  then  be  predicted  by  summing  tha  oreviously  known  effects  of  individual 
lags.  These  predicted  effects  can  again  be  described  in  two  stages:  (a)  the  position  errors 
in  target  and  reticle  movements  and  (b)  the  effects  of  these  position  errors  on 
performance.  Experimental  studies  can  be  conducted  to  investigate  the  effects  of  imposed 
display  lags  and  reticio  lags  on  performance  so  as  to  test  those  predictions.  The  ratios 
between  the  measured  effects  and  tha  predicted  effects  on  performance  can  be  calculated 
fo  different  combinations  of  display  lags  and  reticle  lags.  These  ratios  can  then  be  used 
to  establish  weightings  for  the  contributions  to  tho  overall  effects  from  individual  lags. 

8.6.2  Conclusions  and  recommendatjons 

Few  published  studies  of  the  interactions  among  the  lags  in  a  head-coupled  system  have 
been  found. 

Experimental  studies  to  investigate  the  combined  effects  of  display  lags  and  reticle  lags 
on  performance  are  recommended.  It  is  suggested  that  these  studies  should  be 
accompanied  by  a  model  for  the  prediction  of  the  combined  effects  of  lags. 
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Structure  of  categorization:  conceptual  desciiption  and  visual  illustration 
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The  conceptual  d'^scription 


This  section  describes  the  categorization  process  involved  in  Stage  1  described  in 
Section  3.0. 


An  operator-in-the-loop  head-coupled  simulator  can  be  modelled  as  a  combination  of 
feedback  loops,  with  the  'head-coupled  loop'  as  the  base  (Figure  4.7).  These  feedback 
loops  are  formed  by  combinations  of  simulator  components  wufi  their  associated  sources 
of  lag.  It  is  the  objective  of  this  stage  to  identify  rf.'e  system  architecture  of  a  head- 
coupled  simulator  by  its  simulator  components.  Examples  of  feedback  loops  with  their 
.  imulator  components  and  sources  of  lags  are  listed  as  follows; 


head-coupled 

sirrculator  database; 

computer  image 

loop; 

contputer  image 

generator; 

generator: 

head-pointing  system 

helmet-mounted 

head  position 

display; 

head-pointing  system; 

predictor; 

manual  control 

aircraft  stick  control; 

stick  response; 

loop  without 

aircraft  dynamics 

aircraft  dynamics 

motion  cues; 

simulator; 

Simulator; 

manual  control 

aircraft  stick  control; 

stick  response; 

loop  with 

aircraft  dynamics 

aircraft  dynamics 

motion  cues; 

simulator; 

simulator; 

motion  platform; 

vibrator  response; 

head-slaved 

head-slaved  weapon 

dynamic  response  of 

weapon  control 

simulator; 

the  weapon 

loop. 

cursor  display  unit 

represented  by  a 

to  project  an  aiming 
reticle. 

delayed  aiming  reticle. 

The  above  lists  are  not  meant  to  be  exhaustive,  for  bxample  simulator  components  such 
as  sound  cues  artd  eye-trackers  are  not  listed.  Having  identified  the  components  within 
the  haad-noLipled  .simulator,  a  model  of  the  specified  pilot-in-the-loop  head-coupled 
simulator  can  be  constructed  (e.g.  Figure  4.8). 


74  - 


Visual  illustration  of  the  categorization  process 


As  discussed  in  Section  3.0,  the  detailed  matrix  classification  of  the  variables  suggested 
in  the  contract  has  been  replaced  by  a  combination  of  simulator  modeling  and 
categorization  of  variables  according  to  the  feedback  structure  of  the  model  (see 
Section  5.0).  Consequently,  the  matrix  layout  has  been  replaced  by  a  series  of 
diagrammatic  illustrations  (Stages  1  to  3  are  outlined  in  Section  3.0): 


Stag*  1: 

idanttfying  simulator 
BfchHsciunM  as  a 
oombiiiatiun  a)  aitnulatar 
components  snd  their 
■ssocieiort  saurixis  of  lag: 


■ 

m 

modon 

hMij-»laved 
>  wwiBOon 

Slick 

I'ontroi 

simi.f 

1 

0 

0 

um 

ftlfnl.2 

1 

1 

1 

mSi 

each 

combination 


SUga  2a 

Identify  aaaot:iatad  variiiblMi  for 
itidivkiuBl  feedback  i'<aps: 
a.g.  head-coupled  k  hj  .... 
indspandenc  dependertt 

varisblee  vsfiablas 


_ _ 

Stage  3 

Identify  the  pubUehod  etudiee  concerning 
inleractians  among  different  lime  doiays  within 
a  aimulalor. 


Stage  2b 

Detennlnlr^  ttie  eflact  oi  each  vwiabie 
ragarding  previous  ttw  effaol 

of  manlpulstlngn  engineering  paramel::'*, 
such  «M  bondwidlh.  phese  and  gain  we 
reviewed. 
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APPENDIX  B 


Summaries  of  literature  concerned  with  the  effects  of  lags  on  manual  control  with 

panel  mounted  displays 


Author: 

Aim; 

Equipment: 

Task; 

Subjects: 

Conditions: 


Conclusions: 


Author: 

Aim; 

Equipment; 

Tasks: 

Subjects: 

Conditions: 

Conclusions: 


Allen  R.W..  DiMarco,  R.J.  (1985). 

To  further  understand  the  effect  of  various  potential  sources  of  transport  delays, 
a  computer  model  analysis  was  undertaken  using  a  generic  vehicle  control  model. 
(Manual  control). 

Computer  modeling. 

Basic  control  example  for  the  analysis  model  concerns  generic  vehicle  tracking  (e.g. 
dog-fighting). 

None . 

Three  sources  of  computational  delay: 

1 )  Equivalent  delay  for  vehicle  handling  qualities. 

(0/for  analog  vehicle;  0.075  second  for  modern  digital  aircraft). 

2}  Delay  for  display  system.  (0/  for  analog  processor;  1 00  ms  for  general  CGI 
raster  scan  devices). 

3)  Delay  for  motion  feedback  (no  delay  or  250  ms  for  typical  simulator). 

Control  bandvwidth  of  the  operator/vehicle  system  drops  dramatically  as 
various  delays  are  added  into  the:  sintulation  loop. 

Maximum  vehicle  heading  deviation  nearly  doubles  in  the  worst  delay  case 
compared  to  the  no  delay  condition. 


Bailey,  R.E.,  Knotts,  L.H.  (1987) 

Generation  of  guidelines  and  development  of  a  data  foundation  for  the  specification 
of  allowable  time  delay  in  ground-based  simulators. 

USAF  Flight  Dynamics  Laboratory  NT-33A  variable  stability  aircraft  modified  as 
in-flight  simulator. 

Marriage  of  flying  qualities  and  manual  control  concerns: 

-  fly  the  simulator  witfi  step-and-ramp  attitude  command 

-  compensatory  attitude  tracking  tasks. 

3  evaluation  pilots. 

-  Addition  of  time  delay  in  pitch  and  roll  axes  from  0  to  240  msec. 

-  4  aircraft  configurations  (F-lfj;  C-2l;  C-1  /;  C-141) 

-  Motion  cuing  (Fixed  base/Inf light). 

Pc''  in-flight  simulation  of  highly  manoeuvrable  and  highly  responsive  fighter,  total 
of  up  to  1 50  ms  (100  ms  plus  50  ms  experimental  added  delay)  are  tolerable 
in  a  simulation  environment. 

The  above  e.:perimem  was  replicated  using  the  NT-33  A  as  a  ground  simulator. 
Significant  flying  qualities  differences  were  shown  to  exist  particularly  for  a  highly 
responsive,  aggressively  flown  aircraft. 
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Authoj : 


Aim: 

Equipment: 

Task: 

Subjects: 

Conditions: 

Conclusions: 


Authors: 

Aim: 

Equipment: 

Task: 

Subjects: 

Conditions: 

Conclusions: 


Gum,  D.R.,  Albery,  W.B.  (1976). 

Investigating  the  time  delay  problems,  delay  compensation  and  the  disparity  of 
motion  and  visual  system  cue  in  the  Advanced  Simulator  for  Undergraduate  Pilot 
Training. 

Advanced  Simulator  for  Undergiaduate  Pilot  Training  (ASUPT).  It  comprised:  1) 
two  basic  T-37B  simulators  2)  two  t  ide-angle  visual  displays,  and  3)  a  shared 
visual  computer  image  generator. 

Formation  flight  capability,  approach  and  landing  manoeuvres. 

Unknown. 

Two  delay  compensation  techniques:  1)  single  interval  lead  2)  Taylor  series 
extrapolation  plus  single  interval  lead. 

The  approximate  delays  and  contributions  from  the  visual,  motion  and  G-seat 
system  are  identified  and  measured.  The  greatest  impact  of  delays  seemed  to  be 
in  formation  flight  and  control  of  aircraft  roll  position  which  required  more  precise 
and  rapid  control  than  other  tasks  like  approach  and  landing  manoeuvres. 

Attempts  to  extend  the  extrapolation  resulted  i'*  an  objectionable  lack  of 
smoothness.  Recommendation  was  made  to  abandon  Taylor  series  extrapolation 
in  favor  of  using  only  the  single-interval  lead. 


Hess,  R.A.,  Myers.  A. A.  (1985) 

Analytes  and  experimental  evaluation  of  a  non-linear  filter  configured  to  provide 
phase  iead  without  accompanying  gain  distortion. 

Simple  arrangement  of  CRT  display  and  an  isometr'c  control  stick. 

Single-axis  compensatory  tracking  task  involving  a  human  operator. 

Five  subjects  were  used. 

Four  different  combinations  of  delay  and  compensation  methods  were  used:  1 )  ni. 
delay,  no  compensation  (nominal  case):  2)  0.25  second  delay,  lead-lag 
compensation;  3)  0.25  second  delay,  split-path  nonlinear  filter  (SPAN)  filter;  4) 
Q.25  second  delay,  no  compensation. 

The  non-linear  SPAN  filter  is  superior  to  a  linear  lead/lag  compensator  in  its  ability 
to  maintain  system  stability.  However,  SPAN  does  not  increase  tracking  accuracy 
over  the  lead-lag  filter.  Computer  analysis  indicated  that  this  is  caused  by  the 
harmonics  produced  and  is  most  noticeable  for  low  frequency  inputs.  Finally,  a 
new  arrangement  for  a  SPAN  filter  was  proposed  which  allows  low  frequency 
inputs. 
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Authors; 


Aim: 

Equipment: 

Ta=k; 

Subjects; 

Conditions: 

Conclusions; 


Author: 

Aim; 

Equipment: 

Task: 

Subject; 

Conditions; 

Conclusions: 


Jewell,  W.F.,  Clement,  W.F.  (1935) 

Describe  the  critical  task  tester  al„  rithm  which  can  both  measure  the  effective 
time  delay  of  a  modern  flioht  sim  ilator  and  quantify  the  performance  of  the 
closed'iooD  pilot  simulator  system  relative  to  the  "real  world*  (manual  control). 

Not  specified. 

The  paaicular  manual  control  task  was  to  stabilize  an  unstable  controlled  element 
using  the  critical  tracking  task. 

Not  specified. 

Not  specified. 

Performance  with  1 00  tns  throughout  delay  was  degraded  by  about  26  percent 
and,  at  200  rns,  by  49  percent.  The  technique,  called  the  split  path  nonlinear  filter 
or  SPAN  was  proposed  for  lag  compensation. 


Jewell  W.F.,  Clement,  W.F.  and  Hogue,  J.R.  (1987) 

Describing  the  technique  and  results  in  a  frequency  response  identification  of  a 
computer-generated  image  (CGI)  visual  simulator  (Manual  control). 

Vertical  Motion  Simulator  (VMS)  in  National  Aeronautics  and  Space  Administration 
(NASA)  Arras  Hesearch  Center  (ARC).  It  was  configured  to  simulrvc  UH-60A 

Pitch  attitude  and  heading  control. 

One  UH-60A  teat  pilot. 

With  and  without  a  novel  delay  compensation  scheme. 

Results  show  that  the  CGI  cot  ..ronsation  scheme  can  elimiriato  th@  r>has'i  lag  due 
to  a  pure  time  delay  up  to  about  2  Hz,  but  above  this  frequency,  the  CGI  response 
has  phase  lead  and  gain  amplification. 
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Author:  Johnson,  W.V.,  Middendorf,  M.S.  (1988} 

Aim:  Describa  a  flight  simulator  transport  delay  measurement  technique  along  with 

detailed  apparatus  descriptions  and  application  consideration. 

Equipment:  PDP1 1  /60  digital  compute  was  used  for  real  time  simulation  computer.  The 

graphics  computer  was  a  Silicon  Graphics  Inc.  IRIS  3020  and  the  visual  display  was 
presenter  on  a  1 9  inch  diagonal  raster  scan  monitor.  Primary  delay  measurement 
instrument  was  a  Bcfco  Inc.  frequency  response  analyzer  model  916. 


Task:  The  ph  ise  shift  through  the  simulation,  from  stick  input  to  display  device,  was 

measured  at  a  fixed  frequency. 


Subjects;  - 

Conditions:  - 

Conclusion:  The  req  ency  domain  measurement  technique  proved  to  be  useful  in  measuring 

and  identil',  ng  time  delay  contributions  from  each  part  of  the  simulation  system. 


Eaxsoi 

Inventors:  Lee,  D.R.,  McCreary,  R.B.  Mat  13,  1984. 

Assignee:  The  United  States  of  America  as  represented  by  the  Secretary  of  the  Air  Force, 

Washington,  D.C. 

Abstract:  .An  anti-flutter  apparatus  for  a  head-mounted  visual  display  having  servo-controlled 

reflective  surfaces  to  provide  corrections  to  head  rotations  which  occur  before  a 
visual  scene  g«rieration  system  is  able  to  respond  to  the  head  movement. 


Summary  of  the  invention: 

The  computer  generated  imagery  is  projected  via  a  mirror  system  to  a  head  mounted 
display  system.  A  central  computer  which  controls  the  image  generating  system,  generates 
an  error  signal  which  is  derived  from  a  head  position  sensor  and  the  relative  position  of  the 
generated  scene.  The  error  signal  is  applied  to  the  servo  actuator  unit  to  correct  the  visual 
image  for  the  measured  head  position. 
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Authors: 


Lavison,  W.H.,  Papazian,  B.  <1987> 


Aim: 

Equipment; 

Task; 

Subjects: 

Conditions: 

Conclusions: 


Authors: 

Aim: 

*■  ■juipmen'i 
i'  ask: 

SniiiuCtS 

Conditioua: 

Con-'.lui’cT- 


Explore  the  affects  of  time  delay  and  simulator  mode  on  close-loop  pilot/  vehicle 
performance  by  model  analysis  ano  experimentation  (Manual  control). 

Model:  Optimal  control  mode  (OCM). 

Experiment:  Ground  base  and  in-di«-ht  .simulations  (NT-.33). 

Tarcot-tracking  task  in  roll  axis  and  pitch  axis. 

3  test  pilots. 

-  "I-  )6"and  "C-HI". 

Gruund  based  and  in-flight  simulation. 

-  Addition  of  0  or  1  BO  msec  delay. 

Trends  predicted  by  pro  experiment  model  analysis  wero  largely  confirmed  by  the 
axporimental  study  and  replicated  by  post-experimental  modei  an.i!vsis.  Specifically, 
Addition  of  1 30  msec  delay  caused  an  increase  (around  22%)  in  r.m.s 
tracking  error. 

Dpiau  (tad  largei  effect  on  generic  fighter  flown  aggressively  (’F--18*)  than 
nn  nhe  generic  heavy  ranspoit  ('*C-141*)  flown  in  a  mortt  relaxed  manner, 
trrar  scores  wore  slightly  largi?*-  in  the  ground- bastjrt  simnlrttion  than  in  th« 
in  flight  simulations. 


Malone  H.L.,  Horowiu  S.  (1987) 

Deteiminti  the  maximum  tolerable  between-simulator  transport  delay  (BSTD)  thut 
couIl  bt>  accc(:)ved  before  a  pitot  wocld  make  a  change  in  tactics  during  a  coniibat 
air-to-air  outwork  simulation.  The  use  of  a  predictor  was  also  investigated. 

Air  Combat  Manoouvring  Instrumentation  (ACM!)  «it  Luke  AFB. 

The  manoeuvres  cover  those  most  commonly  used  in  an  A//\  eng0a»'’i«nt:  a  cw' 
trsick-rin  sbor,  missile  shot,  high  defloction  oiin  shot,  and  a  defensive  manoeuvre. 

Five  iiigiiiv  experiariired  fighter  pilots. 

BSTD  clftlays  of  0.  0.2,  O.^i,  1,0  and  1.5.  seconds. 

-  Two  cnndition.5  wuh  and  without  She  predictors. 

For  iho  manoeuvre?;  tv’-sed,  a  delay  of  .250  ms  can  be  .accepted  with  little 
ctearad.ation.  Additionally,  a  simple  first  order  predictoi  can  errtend  this  maximum 
delay  to  oCi)  ms. 


Authors; 


Morriken,  M.S..  Johnson.  W.V.  (13881 


Aim;  Investigate  the  eh'ucts  of  providing  resh world  supplomuntarv  information  to  the 

visual  and  tactile  modalities  to  reduce  the  deleterious  effects  or  a  delayed  primary 
display  on  operator  control  perfcrmance. 

Equipment;  A  fixed-base  simulator  and  an  in-cockpit  motion  simulator.  In  addition,  the  dynamic 
seat  of  the  Advanced  Low  Cost  G-cuing  system  (ALCOGS)  in-cockpit  motion  dovice 
was  used  for  the  motion  supplementary  cue  condition. 

Task;  A  disturbance  regulation  task  where  the  subjects  were  required  to 

constant  altitude  over  a  flat  terrain  grid  and  remain  parallel  with  the  loitgitudinai 
lines.  (All  tasks  had  a  transport  delay  of  ?.00  msi. 

Subjects:  Forty  two  non-piiot  subjects  paiticipsted.  Thay  were  parsed  into  7  groups  or  6 

subjects;  6  experimental  and  one  control  group, 

Conditions:  -  Two  transport  detays  for  supplementaiy  cues;  67  ms  and  200  rns. 

-  Three  cuing  conditions: 

(1)  dynamic  ses;t  motion  cue. 

(2)  altitude  Indicator  cue. 

(3)  peripheral  horizon  cue. 

-  One  control  condition  =  no  cuing. 


Conclusion:  Faster  updating  secondary  cues  produced  better  r.m.s.  error  performance  for 

altitude  control.  The  trend  was  the  satm  for  heedirriQ  control  but  was  not 
'  >  statistically  significant.  When  compared  to  the  coniro!  cosidition  (tro  cuii>g|,  none 

of  slower  cuing  conditions  produced  statisticaliy  signifrcain  perforniance 
improvement  for  either  heading  or  altitude  control.  Hrrweyer,  irr  all  ca/rns. 
performance  was  better  with  faster  cumg. 

'  1 
i'  I 


Authors:  Mlorriken  M.'o.,  Riccio  G.E.  (1987) 

Summary:  Ccnt&ins  a  review  of  the  titorature  concernirjg  the  effecT<i  of  visuaf  feedback  doSsy 

on  pilot  'light  crjntro)  perfciirnanve  in  S!n:uiat!on  environments.  A  .'surnmary  ol 
re.rearch  tc  dote  and  future  resoarch  approaches  taken  by  the  Human  Irngineerino 
Division  of  the  Arrest' '’rig  Aerospaco  Modical  Research  l.aboratorieij  is  also 
presented. 
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Author: 


Aim: 

E-quipmiiint: 

1'ssk: 

Subjects; 

Conditions: 

Conclusion: 


Authors; 

Aim: 

Equipment: 

Task: 

Subjects: 

WUiiufliwi  la. 

Conclusion: 


Miiiar,  G.K.,  i-liisy,  D.R.  j^976j 

Datarmiree  tho  ofhict  oi  visuat-motion  timu  dalay*:  on  pilot  porformanco  of  a 
simuiiicoiJ  pursuit  tnainins!  task. 

Lanfllfliy  Hasaurcii  Cantor  Visual-Motion  Simulator  (VMS). 

Primaiv  -  tiac'k  a  ta/Qot  aircraft  that  was  perl  arming  sinusoidal  oscillation.  (Manual 
tracking) , 

Secondary  ■  tapping  aiternatwo  strips  (to  inci'tiise  tht*  pilot  workl(jad). 

Unknown. 

Tima  delay  =  0.047  to  0.547  second  i-s  steps  of  0.03T25. 

Task  ciilticulties  --  1 5  handling  quality- 

Target  frequency  effects  (50%  &  '100%  increase). 

Motion  cues  ==  vrith/without. 

As  task  difficulty  Ideterminad  by  airplana  handling  qualities  or  targot  frequency) 
increased,  the  amount  of  acceptable  time  cielay  docreiiscid.  However,  when 
relatively  complete  motion  cues  wors  included  in  tho  sirriutation,  the  pilot  could 
maintain  his  performance  for  considerably  longer  time  delays. 


Pfivoznik,  C.M.,  Berry,  O.T.  (1986) 

Measurement  of  pilot  time  delay  as  influenced  by  contrullcs  charoctei'istics  and 
vehicle  time  delays. 

Three  control  stick  configurations:  .space  shuttle  stick  and  conventioiiel 
uenerol-purpose  sticks  with  two  different  spring  constants.  T^:o  siiutt'u  coclqiit 
simulator  in  Ames  Drydan  Simulation  laboratory  was  used 

First-order,  ciose  i-loop,  compensatory  tracking  task  in  pitch  axis  was  used . 


Four  test  pilots  and  one  non-pilot  engineer. 


tV.'O 


e\rct^a«v%  rlel’asrer* 


Cnfici  23*?  rns 


Ths  data  indicate  that  the  heavy  convention  .1  controllor  had  rhs  lowotit  affective 
pilot  tirre  delay  values  associated  with  it,  with  and  without  tlio  addttd  system 
delay.  Each  corttrol  stick  experiment  showed  an  increasu  in  pilot  timi  delay  whftn 
there  was  an  increvee  In  total  delay. 

Changes  in  pilot  rim-3  delay  because  of  increases  in  system  time  du)^y  wero  much 
more  significain  than  ;:hanoe»  oocauss  of  nanipiilator  ct’jroct^trsxtici!, 

A  socondary  experiment  using  the  critical  task  tester  indicated  that  tho  pilot  time 
delay  was  unaffected  by  previous  piloting  experiertce  but  was  influenced  by  video 
game  experience. 
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Author; 


Queijo  M.J.,  Riley  Q-R-  (1975) 


Aim; 

E  imflnt: 
■’jsk: 

Subjects; 

Cooditions; 

Conclusions; 


Auuiurs: 

Aim; 

Equipment; 

Task: 

Subjects; 

Conditions; 

Concvvibions: 


Investigate  the  acceptable  time  delay  in  visual  cues  during  simulated  pilot  tracking 

exercise. 

Langley  Research  Center  Visual-Motion  Simulator  (VMS). 

Primary  -  track  a  target  aircraft  which  was  performing  a  sinusoidal  oscillation  in 

altitude  (Manual  racking). 

Secondary  -  tapping  two  metal  strips  alternately  as  rapidly  as  convenient. 

Two. 

Delay  in  steps  of  0,  1 , 2,  3,  5  and  8  were  used.  (One  step  =  0.031 215  second). 

1)  Increasing  the  task  comploxity  or  dograding  the  vehicle  handling  qualitiii's 
reduces  the  accepta.b!e  iftvel  of  visual-scene  time  delav- 

2)  Even  smaii  delays  in  the  order  of  0.047  sucoEtd  can  have  an  adverse  effect 
on  pilot  parformance  for  some  aircraft  configurations.  The  n^axinnum 
acceptable  time  delay  was  about  0.141  second. 


Riccio,  G.E.,  Cress,  J.D.  (1987) 

inve.stiaat8  the  effects  of  simulator  delays  on  performance,  control  behavior,  and 
transfer  of  training  (Manual  control). 

Flight  dynamics  simulatiors  by  digital  computer  POP1 1  /60  and  display  through 
high  ft!.",' itior  r;!bter->^  -"^nhics  system  (Silicon  Graphics  2400). 

MairitaiK  con.'‘,t3iit  heading  and  altitude  in  the  presence  of  pseudo  random  roii-tate 
and  pitch-rate  disturbances. 

Thirty-six  peopia  participtnod.  T  hey  were  assigned  to  tour  groups  ot  nine  subiects, 
none  of  t!-j  subjects  wore  pilots. 

Four  time-delays:  SO,  100,  200  or  400  ms. 

Two  aircraft  typer,;  Highly  responsive  dynamics  or  .sluggish  dynamics. 

Simniator  delay  degrades  coniinl  performance  throughout  the  learning  process, 
however,  tht;  affects  of  adaing  a  small  amount  cf  delay  (100  ms)  is  negligibie. 

I'Jo  importani  effects  of  small  delays  (100-200  ms)  on  transfer  performance 
(tr^tisfer  of  training  to  a  system  with  smaller  delays)  was  found,  Howuver,  delays 
larger  than  200  ms  may  be  problematic. 


Authors: 


Aim: 

Equipment: 

Task: 

Subjects: 

Conditions: 

Conclusions: 

Authors: 

Aim; 

Equipment: 

Task: 

Subjoctrc 

Conditions: 

Conclusions: 


Sobiski,  D.J.,  Cardullo,  F.M.  (1987) 

Effect  of  delays  in  flight  simulation  is  explored  and  a  predictive  method  of 
compensation  is  tested  in  an  experimental  environment  (Manual  control). 

8G286  based  desk-top  computer  programmed  to  simulate  an  executive  class  jet 
aircraft  dynamics. 

Manual  control  task  (pitch  and  roll)  of  a  linear  model  of  executive  class  jet  aircraft 
dynamics  with  input  disturbances. 

9  subjects  (all  had  simulator  experience). 

1)  With  no  predicting  filter  on  tho  output. 

2)  With  the  lead/lag  filter. 

3)  With  a  full  state  feedback  predictor  filter  with  state  estimation. 

41  With  a  reduced  order  predictor  filter  on  the  output. 

Tims  delays  of  200,  400  and  800  ms  are  inserted  for  each  experiment. 

Frequency  analysis  shows  the  state  predictor  filter  can  restore  phase  and  gain 
margins  to  the  system  for  delay  as  long  as  800  ms. 


Wolfkamp,  J.,  Ramahandran,  S.  (1988) 

Determine  tl-,3  actual  simulator  hardware  time  delay  and  its  effect  on  pilot 
performance. 

McDonnell  Douglas  Helicopter  Company  simulators  including  GEC  CompuScena  IV 
(CIV)  digital  image  generation  cystem,  McFadden  hydraulic  system  and  a  Servo 
Optical  Projection  System  (SOPS)  that  optically  combined  tho  images,  and 
positioned  the  projection  lens  through  servo  control  in  either  a  fixed  forward  mode 
or  in  a  head-tracking  mode. 

Pilots  required  to  fly  three  diffarxr.t  types  of  course;  narrow  slalom/dolphin; 
serpentine  and  lonctt):di;'.al  quickstop. 

\  pilots  took  part. 

Pilots  were  exposed  to  0.  2,  4,  6  and  10  frames  delay.  (One  frame  delay  is  1 6.7 
ms) 

Measurements  showed  that  the  average  Throughput  delay  was  approximately  87 
ms. 

(VO  dramatic  changes  du'S  vo  increased  simulator  delay  were  found  but  pilot  cortrol 
activity  was  increased  in  the  low  speed,  high  gcin  tasks. 
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